Sep 07 13:37:52 devstack cinder-volume[76591]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 13:37:52 devstack cinder-volume[76591]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 13:37:52 devstack cinder-volume[76591]: we strongly recommend against using it for new projects. Sep 07 13:37:52 devstack cinder-volume[76591]: If you are already using Eventlet, we recommend migrating to a different Sep 07 13:37:52 devstack cinder-volume[76591]: framework. For more detail see Sep 07 13:37:52 devstack cinder-volume[76591]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 13:37:52 devstack cinder-volume[76591]: import eventlet # noqa Sep 07 13:37:55 devstack cinder-volume[76591]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76591) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 13:37:55 devstack cinder-volume[76591]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76591) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 13:37:55 devstack cinder-volume[76591]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76591) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 13:37:56 devstack cinder-volume[76591]: INFO dbcounter [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Registered counter for database cinder Sep 07 13:37:56 devstack cinder-volume[76591]: DEBUG oslo_db.sqlalchemy.engines [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76591) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:37:56 devstack cinder-volume[76591]: DEBUG dbcounter [-] [76591] Writer thread running {{(pid=76591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 13:37:56 devstack cinder-volume[76591]: INFO cinder.rpc [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 13:37:56 devstack cinder-volume[76591]: INFO cinder.rpc [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_db.sqlalchemy.engines [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76591) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:37:57 devstack cinder-volume[76591]: INFO cinder.volume.manager [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Determined volume DB was empty at startup. Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG cinder.volume.manager [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76591) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 13:37:57 devstack cinder-volume[76591]: INFO cinder.volume.manager [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 07 13:37:57 devstack cinder-volume[76591]: WARNING stevedore.named [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 13:37:57 devstack cinder-volume[76591]: WARNING castellan.key_manager [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 13:37:57 devstack cinder-volume[76591]: WARNING cinder.keymgr.conf_key_mgr [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG cinder.volume.drivers.lvm [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76591) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_concurrency.processutils [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_concurrency.processutils [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] CMD "cinder-rtstool verify" returned: 0 in 0.454s {{(pid=76591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_db.sqlalchemy.engines [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76591) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:37:57 devstack cinder-volume[76591]: INFO cinder.rpc [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 07 13:37:57 devstack cinder-volume[76591]: INFO cinder.rpc [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 07 13:37:57 devstack cinder-volume[76591]: WARNING stevedore.named [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 13:37:57 devstack cinder-volume[76591]: WARNING castellan.key_manager [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 13:37:57 devstack cinder-volume[76591]: INFO cinder.volume.manager [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_db.sqlalchemy.engines [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76591) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:37:57 devstack cinder-volume[76591]: INFO oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Starting 1 workers Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Started child 76786 {{(pid=76591) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Full set of CONF: {{(pid=76591) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] ******************************************************************************** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Configuration options gathered from: {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] ================================================================================ {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] allow_availability_zone_fallback = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] allow_compression_on_image_upload = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] allowed_direct_url_schemes = [] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] api_rate_limit = True {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] auth_strategy = keystone {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] az_cache_duration = 3600 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_availability_zone = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_host = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_name = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_stats_polling_interval = 60 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backup_api_class = cinder.backup.api.API {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76786]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backup_name_template = backup-%s {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backup_use_same_host = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backup_use_temp_snapshot = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] chap_password = **** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] chap_username = {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cinder_internal_tenant_project_id = 33a596cf3bbb44b2847320b8dcfdb3be {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cinder_internal_tenant_user_id = 8b944e4266aa4bd5affa88261549ebb1 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cloned_volume_same_az = True {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cluster = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] compression_format = gzip {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] compute_api_class = cinder.compute.nova.API {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] config_dir = [] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] config_source = [] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] control_exchange = openstack {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] debug = True {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] default_availability_zone = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] default_group_type = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] default_volume_type = lvmdriver-1 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] disk_geometry = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] driver_client_cert = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] driver_client_cert_key = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] driver_data_namespace = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] driver_ssl_cert_path = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] driver_ssl_cert_verify = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] driver_use_ssl = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] enable_force_upload = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] enable_new_services = True {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] enable_unsupported_driver = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] enforce_multipath_for_image_xfer = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] filter_function = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] glance_api_insecure = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] glance_api_servers = ['http://192.168.122.6/image'] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] glance_api_ssl_compression = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] glance_ca_certificates_file = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] glance_catalog_info = image:glance:publicURL {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] glance_certfile = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] glance_keyfile = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] glance_num_retries = 3 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] glance_request_timeout = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] goodness_function = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] graceful_shutdown_timeout = 5 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] group_api_class = cinder.group.api.API {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] host = devstack {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] image_compress_on_upload = True {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] image_conversion_address_space_limit = 1 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] image_conversion_cpu_limit = 60 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] image_conversion_disable = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] image_upload_use_cinder_backend = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] image_upload_use_internal_tenant = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] image_volume_cache_enabled = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] image_volume_cache_max_count = 0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] image_volume_cache_max_size_gb = 0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] init_host_max_objects_retrieval = 0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] instance_format = [instance: %(uuid)s] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] iscsi_target_flags = {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] iscsi_write_cache = on {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] iser_helper = tgtadm {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] iser_ip_address = 192.168.122.6 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] iser_port = 3260 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] log_color = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] log_config_append = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] log_dir = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] log_file = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] log_options = True {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] log_rotate_interval = 1 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] log_rotate_interval_type = days {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] log_rotation_type = none {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] max_age = 0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] max_logfile_count = 30 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76786]: INFO cinder.volume.manager [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 07 13:37:57 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] max_logfile_size_mb = 200 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] max_over_subscription_ratio = 20.0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] message_reap_interval = 86400 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] message_ttl = 2592000 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] migration_create_volume_timeout_secs = 300 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] monkey_patch = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] monkey_patch_modules = [] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] my_ip = 192.168.122.6 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] no_snapshot_gb_quota = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] num_iser_scan_tries = 3 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] num_shell_tries = 3 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] num_volume_device_scan_tries = 3 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] nvmeof_conn_info_version = 1 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] nvmet_ns_id = 10 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] nvmet_port_id = 1 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] osapi_max_limit = 1000 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] osapi_volume_ext_list = [] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] osapi_volume_listen_port = 8776 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] osapi_volume_use_ssl = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] osapi_volume_workers = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] per_volume_size_limit = -1 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] periodic_fuzzy_delay = 60 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] periodic_interval = 60 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] public_endpoint = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] publish_errors = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] quota_backup_gigabytes = 1000 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] quota_backups = 10 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] quota_gigabytes = 1000 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] quota_groups = 10 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] quota_snapshots = 10 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] quota_volumes = 10 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] rate_limit_burst = 0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] rate_limit_except_level = CRITICAL {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] rate_limit_interval = 0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] reinit_driver_count = 3 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] replication_device = **** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] report_discard_supported = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] report_interval = 120 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] reservation_clean_interval = 86400 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] reservation_expire = 86400 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] reserved_image_namespaces = [] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] reserved_percentage = 0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] rpc_response_timeout = 120 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] run_external_periodic_tasks = True {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] scst_target_driver = iscsi {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] scst_target_iqn_name = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] service_down_time = 720 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] shell_completion = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] snapshot_name_template = snapshot-%s {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] snapshot_same_host = True {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] split_loggers = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] state_path = /opt/stack/data/cinder {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] storage_availability_zone = nova {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] storage_protocol = iSCSI {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] syslog_log_facility = LOG_USER {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] target_helper = lioadm {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] target_ip_address = 192.168.122.6 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.070s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] target_port = 3260 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] target_protocol = iscsi {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] target_secondary_ip_addresses = [] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] trace_flags = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] transport_url = **** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] until_refresh = 0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] use_chap_auth = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] use_default_quota_class = True {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] use_journal = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] use_json = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] use_multipath_for_image_xfer = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] use_stderr = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] use_syslog = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] verify_glance_signatures = enabled {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] volume_api_class = cinder.volume.api.API {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] volume_backend_name = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] volume_clear = zero {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] volume_clear_ionice = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] volume_clear_size = 0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] volume_copy_bps_limit = 0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] volume_dd_blocksize = 1M {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] volume_name_template = volume-%s {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] volume_service_inithost_offload = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] volume_usage_audit_period = month {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] zoning_mode = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:37:57 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_concurrency.disable_process_locking = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.auth_section = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.auth_type = password {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.auth_version = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.cache = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.certfile = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.include_service_catalog = True {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.insecure = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.interface = public {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.keyfile = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.memcache_password = **** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.memcache_username = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.region_name = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.service_type = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.6/identity {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.backend = dogpile.cache.null {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.backend_argument = **** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.backend_expiration_time = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.config_prefix = cache.oslo {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.debug_cache_backend = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.enable_retry_client = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.enable_socket_keepalive = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.enabled = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.expiration_time = 600 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.hashclient_retry_attempts = 2 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.memcache_dead_retry = 300 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.memcache_pool_maxsize = 10 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.memcache_sasl_enabled = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.password = **** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.proxies = [] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.redis_db = 0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.redis_server = localhost:6379 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.retry_attempts = 2 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.retry_delay = 0.0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.socket_keepalive_count = 1 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.socket_keepalive_idle = 1 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.socket_keepalive_interval = 1 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.socket_timeout = 1.0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.tls_allowed_ciphers = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.tls_cafile = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.tls_certfile = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.tls_enabled = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.tls_keyfile = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cache.username = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] coordination.backend_url = **** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] database.asyncio_connection = **** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] database.asyncio_slave_connection = **** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] database.backend = sqlalchemy {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] database.connection = **** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] database.connection_debug = 0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] database.connection_parameters = {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] database.connection_recycle_time = 3600 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] database.connection_trace = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] database.db_inc_retry_interval = True {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] database.db_max_retries = 20 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] database.db_max_retry_interval = 10 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] database.db_retry_interval = 1 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] database.max_overflow = 50 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] database.max_pool_size = 5 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] database.max_retries = 10 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] database.mysql_wsrep_sync_wait = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] database.pool_timeout = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] database.retry_interval = 10 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] database.slave_connection = **** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] database.sqlite_synchronous = True {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] database.synchronous_reader = True {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] database.use_db_reconnect = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.071s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_tracing.insecure = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] profiler.connection_string = messaging:// {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] profiler.enabled = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] profiler.es_doc_type = notification {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] profiler.es_scroll_size = 10000 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] profiler.es_scroll_time = 2m {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] profiler.filter_error_trace = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] profiler.hmac_keys = **** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] profiler.sentinel_service_name = mymaster {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] profiler.socket_timeout = 0.1 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] profiler.trace_requests = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] profiler.trace_sqlalchemy = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] profiler_jaeger.process_tags = {} {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] profiler_jaeger.service_name_prefix = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] profiler_otlp.service_name_prefix = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_policy.enforce_new_defaults = True {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_policy.policy_default_rule = default {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_policy.policy_file = policy.yaml {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] privsep_osbrick.group = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] privsep_osbrick.helper_command = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] privsep_osbrick.user = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cinder_sys_admin.group = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cinder_sys_admin.helper_command = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] cinder_sys_admin.user = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] service_user.auth_section = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] service_user.auth_type = password {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] service_user.cafile = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] service_user.certfile = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] service_user.collect_timing = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] service_user.insecure = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] service_user.keyfile = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] service_user.send_service_user_token = True {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] service_user.split_loggers = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] service_user.timeout = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] service_user.tls_ciphers = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] service_user.tls_min_version = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] glance.auth_section = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] glance.auth_type = password {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] glance.certfile = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] glance.collect_timing = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] glance.insecure = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] glance.keyfile = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] glance.region_name = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] glance.split_loggers = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] glance.timeout = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] glance.tls_ciphers = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] glance.tls_min_version = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.backend_availability_zone = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.chap_password = **** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.chap_username = {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.057s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.disk_geometry = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.driver_client_cert = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.driver_client_cert_key = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.driver_data_namespace = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.driver_use_ssl = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.extra_capabilities = {} {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.filter_function = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.goodness_function = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.iscsi_target_flags = {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.iscsi_write_cache = on {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.iser_helper = tgtadm {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.iser_ip_address = 192.168.122.6 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.iser_port = 3260 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.lvm_share_target = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.lvm_type = auto {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.num_shell_tries = 3 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.replication_device = **** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.report_discard_supported = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.reserved_percentage = 0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.target_helper = tgtadm {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.target_ip_address = 192.168.122.6 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.target_port = 3260 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.target_protocol = iscsi {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.trace_flags = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.unique_fqdn_network = True {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.use_chap_auth = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack sudo[76809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.volume_backend_name = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.volume_clear = zero {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.volume_clear_ionice = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.volume_clear_size = 0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack sudo[76809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_reports.file_event_handler = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_reports.log_dir = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.backend_host = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.chap_password = **** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.chap_username = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.disk_geometry = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.driver_client_cert = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.extra_capabilities = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.filter_function = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.goodness_function = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.iser_helper = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.iser_ip_address = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.iser_port = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.lvm_share_target = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.lvm_type = auto {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.num_shell_tries = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.replication_device = **** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.report_discard_supported = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.reserved_percentage = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.scst_target_driver = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.storage_protocol = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.target_helper = lioadm {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.target_ip_address = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.target_port = 3260 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.trace_flags = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.use_chap_auth = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.volume_clear = zero {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.volume_clear_size = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] lvmdriver-1.volumes_dir = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.ssl = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_notifications.driver = [] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_notifications.retry = -1 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] key_manager.fixed_key = **** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican.barbican_api_version = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican.barbican_endpoint = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican.barbican_endpoint_type = public {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican.barbican_region_name = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican.cafile = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican.certfile = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican.collect_timing = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican.insecure = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican.keyfile = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican.number_of_retries = 60 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican.retry_delay = 1 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican.send_service_user_token = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican.split_loggers = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican.timeout = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican.tls_ciphers = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican.tls_min_version = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican.verify_ssl = True {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican.verify_ssl_path = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican_service_user.auth_section = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican_service_user.auth_type = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican_service_user.cafile = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican_service_user.certfile = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican_service_user.collect_timing = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican_service_user.insecure = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican_service_user.keyfile = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican_service_user.split_loggers = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican_service_user.timeout = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican_service_user.tls_ciphers = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] barbican_service_user.tls_min_version = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] vault.approle_role_id = **** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] vault.approle_secret_id = **** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] vault.auth_method = approle {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] vault.auth_path = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] vault.kv_mountpoint = secret {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] vault.kv_path = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] vault.kv_version = 2 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] vault.namespace = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] vault.root_token_id = **** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] vault.ssl_ca_crt_file = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] vault.timeout = 60.0 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] vault.token_file = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] vault.token_role = None {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] vault.use_ssl = False {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:37:58 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] ******************************************************************************** {{(pid=76591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 13:37:58 devstack sudo[76809]: pam_unix(sudo:session): session closed for user root Sep 07 13:37:58 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.321s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:37:58 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:37:58 devstack sudo[76927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:37:58 devstack sudo[76927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:37:58 devstack sudo[76927]: pam_unix(sudo:session): session closed for user root Sep 07 13:37:58 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.254s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:37:58 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 13:37:58 devstack cinder-volume[76786]: INFO cinder.brick.local_dev.lvm [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 07 13:37:58 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:37:58 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:37:58 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:37:58 devstack sudo[77020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 13:37:58 devstack sudo[77020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:37:58 devstack sudo[77020]: pam_unix(sudo:session): session closed for user root Sep 07 13:37:58 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:37:58 devstack cinder-volume[76786]: DEBUG cinder.brick.local_dev.lvm [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76786) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 07 13:37:58 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:37:58 devstack sudo[77103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:37:58 devstack sudo[77103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:37:59 devstack sudo[77103]: pam_unix(sudo:session): session closed for user root Sep 07 13:37:59 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.515s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:37:59 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:37:59 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:37:59 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:37:59 devstack sudo[77291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:37:59 devstack sudo[77291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:37:59 devstack sudo[77291]: pam_unix(sudo:session): session closed for user root Sep 07 13:37:59 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:37:59 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:37:59 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:37:59 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:37:59 devstack sudo[77398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 07 13:37:59 devstack sudo[77398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:38:00 devstack sudo[77398]: pam_unix(sudo:session): session closed for user root Sep 07 13:38:00 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.270s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:00 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:00 devstack sudo[77401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 13:38:00 devstack sudo[77401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:38:00 devstack sudo[77401]: pam_unix(sudo:session): session closed for user root Sep 07 13:38:00 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.331s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:00 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:00 devstack sudo[77485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 13:38:00 devstack sudo[77485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:38:00 devstack sudo[77485]: pam_unix(sudo:session): session closed for user root Sep 07 13:38:00 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:00 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:00 devstack sudo[77488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:38:00 devstack sudo[77488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:38:01 devstack sudo[77488]: pam_unix(sudo:session): session closed for user root Sep 07 13:38:01 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:01 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:01 devstack sudo[77529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:38:01 devstack sudo[77529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:38:01 devstack sudo[77529]: pam_unix(sudo:session): session closed for user root Sep 07 13:38:01 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.307s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:01 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:01 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:01 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:01 devstack sudo[77587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:38:01 devstack sudo[77587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:38:01 devstack sudo[77587]: pam_unix(sudo:session): session closed for user root Sep 07 13:38:01 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:01 devstack cinder-volume[76786]: INFO cinder.volume.drivers.lvm [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 07 13:38:01 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:01 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:01 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:01 devstack sudo[77591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:38:01 devstack sudo[77591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:38:01 devstack sudo[77591]: pam_unix(sudo:session): session closed for user root Sep 07 13:38:01 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:01 devstack cinder-volume[76786]: DEBUG cinder.volume.drivers.lvm [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Updating volume stats {{(pid=76786) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 13:38:01 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:01 devstack sudo[77594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 13:38:01 devstack sudo[77594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:38:02 devstack sudo[77594]: pam_unix(sudo:session): session closed for user root Sep 07 13:38:02 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:02 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:02 devstack sudo[77597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:38:02 devstack sudo[77597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:38:02 devstack sudo[77597]: pam_unix(sudo:session): session closed for user root Sep 07 13:38:02 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.238s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:02 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:02 devstack sudo[77600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:38:02 devstack sudo[77600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:38:02 devstack sudo[77600]: pam_unix(sudo:session): session closed for user root Sep 07 13:38:02 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:02 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:02 devstack sudo[77603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:38:02 devstack sudo[77603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:38:02 devstack sudo[77603]: pam_unix(sudo:session): session closed for user root Sep 07 13:38:02 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:02 devstack cinder-volume[76786]: INFO cinder.volume.driver [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Driver hasn't implemented _init_vendor_properties() Sep 07 13:38:02 devstack cinder-volume[76786]: DEBUG cinder.volume.driver [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76786) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 13:38:02 devstack cinder-volume[76786]: DEBUG oslo_db.sqlalchemy.engines [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76786) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:38:02 devstack cinder-volume[76786]: DEBUG dbcounter [-] [76786] Writer thread running {{(pid=76786) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 13:38:02 devstack cinder-volume[76786]: DEBUG cinder.db.api [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Building query based on filter {{(pid=76786) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 13:38:03 devstack cinder-volume[76786]: DEBUG cinder.image.image_utils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76786) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 13:38:03 devstack cinder-volume[76786]: INFO cinder.keymgr.migration [None req-15730e84-84f9-4a68-8115-c223d399bccf None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 13:38:03 devstack cinder-volume[76786]: DEBUG cinder.volume.drivers.lvm [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Updating volume stats {{(pid=76786) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 13:38:03 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:03 devstack sudo[77606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 13:38:03 devstack sudo[77606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:38:03 devstack sudo[77606]: pam_unix(sudo:session): session closed for user root Sep 07 13:38:03 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:03 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:03 devstack sudo[77610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:38:03 devstack sudo[77610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:38:03 devstack sudo[77610]: pam_unix(sudo:session): session closed for user root Sep 07 13:38:03 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:03 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:03 devstack sudo[77615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:38:03 devstack sudo[77615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:38:03 devstack sudo[77615]: pam_unix(sudo:session): session closed for user root Sep 07 13:38:03 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:03 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:03 devstack sudo[77618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:38:03 devstack sudo[77618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:38:04 devstack sudo[77618]: pam_unix(sudo:session): session closed for user root Sep 07 13:38:04 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:04 devstack cinder-volume[76786]: DEBUG cinder.manager [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Notifying Schedulers of capabilities ... {{(pid=76786) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:38:04 devstack cinder-volume[76786]: INFO cinder.volume.manager [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Driver initialization completed successfully. Sep 07 13:38:04 devstack cinder-volume[76786]: INFO cinder.manager [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Initiating service 2 cleanup Sep 07 13:38:04 devstack cinder-volume[76786]: INFO cinder.manager [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Service 2 cleanup completed. Sep 07 13:38:04 devstack cinder-volume[76786]: DEBUG cinder.service [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Creating RPC server for service cinder-volume {{(pid=76786) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 13:38:04 devstack cinder-volume[76786]: DEBUG cinder.service [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76786) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 13:38:04 devstack cinder-volume[76786]: INFO cinder.volume.manager [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 07 13:38:04 devstack cinder-volume[76786]: DEBUG cinder.volume.drivers.lvm [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Updating volume stats {{(pid=76786) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 13:38:04 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:04 devstack sudo[77621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 13:38:04 devstack sudo[77621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:38:04 devstack sudo[77621]: pam_unix(sudo:session): session closed for user root Sep 07 13:38:04 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:04 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:04 devstack sudo[77629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:38:04 devstack sudo[77629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:38:04 devstack sudo[77629]: pam_unix(sudo:session): session closed for user root Sep 07 13:38:04 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:04 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:04 devstack sudo[77632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:38:04 devstack sudo[77632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:38:05 devstack sudo[77632]: pam_unix(sudo:session): session closed for user root Sep 07 13:38:05 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:05 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:05 devstack sudo[77635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:38:05 devstack sudo[77635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:38:05 devstack sudo[77635]: pam_unix(sudo:session): session closed for user root Sep 07 13:38:05 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:05 devstack cinder-volume[76786]: INFO cinder.volume.manager [None req-28adc9dc-700b-4cc5-a410-b22e03e9dc9d None None] Driver post RPC initialization completed successfully. Sep 07 13:38:07 devstack cinder-volume[76591]: DEBUG dbcounter [-] [76591] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:38:14 devstack cinder-volume[76786]: DEBUG dbcounter [-] [76786] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76786) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:38:15 devstack cinder-volume[76786]: DEBUG dbcounter [-] [76786] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=76786) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:38:51 devstack cinder-volume[76786]: DEBUG oslo_service.periodic_task [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Running periodic task VolumeManager._thread_info {{(pid=76786) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:38:51 devstack cinder-volume[76786]: DEBUG cinder.volume.manager [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] thread count: 6 {{(pid=76786) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:38:51 devstack cinder-volume[76786]: DEBUG cinder.volume.manager [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] thread info: [<_MainThread(MainThread, started 136946927313024)>, , , , , ] {{(pid=76786) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:39:51 devstack cinder-volume[76786]: DEBUG oslo_service.periodic_task [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76786) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:39:51 devstack cinder-volume[76786]: DEBUG cinder.volume.drivers.lvm [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Updating volume stats {{(pid=76786) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 13:39:51 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:39:51 devstack sudo[82825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 13:39:51 devstack sudo[82825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:39:51 devstack sudo[82825]: pam_unix(sudo:session): session closed for user root Sep 07 13:39:51 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:39:51 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:39:51 devstack sudo[82828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:39:51 devstack sudo[82828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:39:51 devstack sudo[82828]: pam_unix(sudo:session): session closed for user root Sep 07 13:39:51 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:39:51 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:39:51 devstack sudo[82831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:39:51 devstack sudo[82831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:39:52 devstack sudo[82831]: pam_unix(sudo:session): session closed for user root Sep 07 13:39:52 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:39:52 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:39:52 devstack sudo[82834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:39:52 devstack sudo[82834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:39:52 devstack sudo[82834]: pam_unix(sudo:session): session closed for user root Sep 07 13:39:52 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:39:52 devstack cinder-volume[76786]: DEBUG cinder.manager [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Notifying Schedulers of capabilities ... {{(pid=76786) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:39:52 devstack cinder-volume[76786]: DEBUG oslo_service.periodic_task [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Running periodic task VolumeManager._thread_info {{(pid=76786) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:39:52 devstack cinder-volume[76786]: DEBUG cinder.volume.manager [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] thread count: 6 {{(pid=76786) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:39:52 devstack cinder-volume[76786]: DEBUG cinder.volume.manager [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] thread info: [<_MainThread(MainThread, started 136946927313024)>, , , , , ] {{(pid=76786) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:40:15 devstack cinder-volume[76786]: DEBUG dbcounter [-] [76786] Writing DB stats cinder:SELECT=1 {{(pid=76786) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:40:15 devstack cinder-volume[76786]: DEBUG dbcounter [-] [76786] Writing DB stats cinder:UPDATE=1 {{(pid=76786) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:40:51 devstack cinder-volume[76786]: DEBUG oslo_service.periodic_task [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76786) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:40:51 devstack cinder-volume[76786]: DEBUG cinder.volume.drivers.lvm [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Updating volume stats {{(pid=76786) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 13:40:51 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:40:51 devstack sudo[84565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 13:40:51 devstack sudo[84565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:40:51 devstack sudo[84565]: pam_unix(sudo:session): session closed for user root Sep 07 13:40:51 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:40:51 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:40:51 devstack sudo[84588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:40:51 devstack sudo[84588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:40:51 devstack sudo[84588]: pam_unix(sudo:session): session closed for user root Sep 07 13:40:51 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:40:51 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:40:51 devstack sudo[84592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:40:51 devstack sudo[84592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:40:52 devstack sudo[84592]: pam_unix(sudo:session): session closed for user root Sep 07 13:40:52 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:40:52 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:40:52 devstack sudo[84596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:40:52 devstack sudo[84596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:40:52 devstack sudo[84596]: pam_unix(sudo:session): session closed for user root Sep 07 13:40:52 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:40:52 devstack cinder-volume[76786]: DEBUG cinder.manager [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Notifying Schedulers of capabilities ... {{(pid=76786) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:40:52 devstack cinder-volume[76786]: DEBUG oslo_service.periodic_task [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Running periodic task VolumeManager._thread_info {{(pid=76786) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:40:52 devstack cinder-volume[76786]: DEBUG cinder.volume.manager [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] thread count: 6 {{(pid=76786) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:40:52 devstack cinder-volume[76786]: DEBUG cinder.volume.manager [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] thread info: [<_MainThread(MainThread, started 136946927313024)>, , , , , ] {{(pid=76786) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:41:51 devstack cinder-volume[76786]: DEBUG oslo_service.periodic_task [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76786) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:41:51 devstack cinder-volume[76786]: DEBUG cinder.volume.drivers.lvm [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Updating volume stats {{(pid=76786) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 13:41:51 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:41:51 devstack sudo[85948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 13:41:51 devstack sudo[85948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:41:51 devstack sudo[85948]: pam_unix(sudo:session): session closed for user root Sep 07 13:41:51 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:41:51 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:41:51 devstack sudo[85951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:41:51 devstack sudo[85951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:41:51 devstack sudo[85951]: pam_unix(sudo:session): session closed for user root Sep 07 13:41:51 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:41:51 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:41:51 devstack sudo[85965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:41:51 devstack sudo[85965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:41:52 devstack sudo[85965]: pam_unix(sudo:session): session closed for user root Sep 07 13:41:52 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:41:52 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:41:52 devstack sudo[85968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:41:52 devstack sudo[85968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:41:52 devstack sudo[85968]: pam_unix(sudo:session): session closed for user root Sep 07 13:41:52 devstack cinder-volume[76786]: DEBUG oslo_concurrency.processutils [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:41:52 devstack cinder-volume[76786]: DEBUG cinder.manager [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Notifying Schedulers of capabilities ... {{(pid=76786) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:41:52 devstack cinder-volume[76786]: DEBUG oslo_service.periodic_task [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] Running periodic task VolumeManager._thread_info {{(pid=76786) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:41:52 devstack cinder-volume[76786]: DEBUG cinder.volume.manager [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] thread count: 6 {{(pid=76786) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:41:52 devstack cinder-volume[76786]: DEBUG cinder.volume.manager [None req-96f6dd8e-9635-4eaa-9c26-b02831dbed17 None None] thread info: [<_MainThread(MainThread, started 136946927313024)>, , , , , ] {{(pid=76786) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:42:15 devstack cinder-volume[76786]: DEBUG dbcounter [-] [76786] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76786) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:42:24 devstack cinder-volume[76591]: INFO oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Caught SIGTERM, stopping children Sep 07 13:42:24 devstack cinder-volume[76591]: DEBUG oslo_concurrency.lockutils [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Acquiring lock "singleton_lock" {{(pid=76591) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 13:42:24 devstack cinder-volume[76591]: DEBUG oslo_concurrency.lockutils [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Acquired lock "singleton_lock" {{(pid=76591) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 13:42:24 devstack cinder-volume[76591]: DEBUG oslo_concurrency.lockutils [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Releasing lock "singleton_lock" {{(pid=76591) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 13:42:24 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Stop services. {{(pid=76591) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 07 13:42:24 devstack cinder-volume[76591]: DEBUG oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Killing children. {{(pid=76591) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 07 13:42:24 devstack cinder-volume[76591]: INFO oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Waiting on 1 children to exit Sep 07 13:42:29 devstack cinder-volume[76786]: DEBUG oslo_concurrency.lockutils [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Acquiring lock "singleton_lock" {{(pid=76786) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 13:42:29 devstack cinder-volume[76786]: DEBUG oslo_concurrency.lockutils [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Acquired lock "singleton_lock" {{(pid=76786) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 13:42:29 devstack cinder-volume[76786]: DEBUG oslo_concurrency.lockutils [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Releasing lock "singleton_lock" {{(pid=76786) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 13:42:29 devstack cinder-volume[76786]: WARNING amqp [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 13:42:29 devstack cinder-volume[76786]: WARNING amqp [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 13:42:29 devstack cinder-volume[76591]: INFO oslo_service.backend._eventlet.service [None req-3ad3e4b8-17b8-4c1a-bb9f-77fc0baabba8 None None] Child 76786 exited with status 0 Sep 07 13:42:29 devstack cinder-volume[86765]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 13:42:29 devstack cinder-volume[86765]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 13:42:29 devstack cinder-volume[86765]: we strongly recommend against using it for new projects. Sep 07 13:42:29 devstack cinder-volume[86765]: If you are already using Eventlet, we recommend migrating to a different Sep 07 13:42:29 devstack cinder-volume[86765]: framework. For more detail see Sep 07 13:42:29 devstack cinder-volume[86765]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 13:42:29 devstack cinder-volume[86765]: import eventlet # noqa Sep 07 13:42:31 devstack cinder-volume[86765]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 13:42:31 devstack cinder-volume[86765]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 13:42:31 devstack cinder-volume[86765]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 13:42:32 devstack cinder-volume[86765]: INFO dbcounter [None req-002c8830-89c4-41b8-b752-27040120239f None None] Registered counter for database cinder Sep 07 13:42:32 devstack cinder-volume[86765]: DEBUG oslo_db.sqlalchemy.engines [None req-002c8830-89c4-41b8-b752-27040120239f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86765) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:42:32 devstack cinder-volume[86765]: DEBUG dbcounter [-] [86765] Writer thread running {{(pid=86765) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 13:42:32 devstack cinder-volume[86765]: INFO cinder.rpc [None req-002c8830-89c4-41b8-b752-27040120239f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 13:42:32 devstack cinder-volume[86765]: INFO cinder.rpc [None req-002c8830-89c4-41b8-b752-27040120239f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 13:42:32 devstack cinder-volume[86765]: DEBUG oslo_db.sqlalchemy.engines [None req-002c8830-89c4-41b8-b752-27040120239f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86765) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:42:32 devstack cinder-volume[86765]: INFO cinder.volume.manager [None req-002c8830-89c4-41b8-b752-27040120239f None None] Determined volume DB was empty at startup. Sep 07 13:42:32 devstack cinder-volume[86765]: DEBUG cinder.volume.manager [None req-002c8830-89c4-41b8-b752-27040120239f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86765) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 13:42:32 devstack cinder-volume[86765]: INFO cinder.volume.manager [None req-002c8830-89c4-41b8-b752-27040120239f None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 07 13:42:32 devstack cinder-volume[86765]: WARNING stevedore.named [None req-002c8830-89c4-41b8-b752-27040120239f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 13:42:32 devstack cinder-volume[86765]: WARNING castellan.key_manager [None req-002c8830-89c4-41b8-b752-27040120239f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 13:42:32 devstack cinder-volume[86765]: WARNING cinder.keymgr.conf_key_mgr [None req-002c8830-89c4-41b8-b752-27040120239f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 13:42:33 devstack cinder-volume[86765]: INFO cinder.volume.manager [None req-002c8830-89c4-41b8-b752-27040120239f None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_db.sqlalchemy.engines [None req-002c8830-89c4-41b8-b752-27040120239f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86765) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:42:33 devstack cinder-volume[86765]: INFO oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] Starting 1 workers Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] Started child 86980 {{(pid=86765) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] Full set of CONF: {{(pid=86765) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] ******************************************************************************** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] Configuration options gathered from: {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] ================================================================================ {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] allow_availability_zone_fallback = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] allow_compression_on_image_upload = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] allowed_direct_url_schemes = [] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] api_rate_limit = True {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] auth_strategy = keystone {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_availability_zone = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_host = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_name = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_stats_polling_interval = 60 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backup_api_class = cinder.backup.api.API {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backup_name_template = backup-%s {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backup_use_same_host = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backup_use_temp_snapshot = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] chap_password = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] chap_username = {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cinder_internal_tenant_project_id = 33a596cf3bbb44b2847320b8dcfdb3be {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cinder_internal_tenant_user_id = 8b944e4266aa4bd5affa88261549ebb1 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86980]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cluster = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] compression_format = gzip {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] compute_api_class = cinder.compute.nova.API {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] config_dir = [] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] config_source = [] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] control_exchange = openstack {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] debug = True {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] default_availability_zone = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] default_group_type = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] default_volume_type = QuobyteHD {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] disk_geometry = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] driver_client_cert = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] driver_client_cert_key = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] driver_data_namespace = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] driver_ssl_cert_path = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] driver_ssl_cert_verify = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] driver_use_ssl = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] enable_new_services = True {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] enable_unsupported_driver = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] enabled_backends = ['QuobyteHD'] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] enforce_multipath_for_image_xfer = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] filter_function = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] glance_api_insecure = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] glance_api_servers = ['http://192.168.122.6/image'] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] glance_api_ssl_compression = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] glance_ca_certificates_file = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] glance_catalog_info = image:glance:publicURL {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] glance_certfile = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] glance_keyfile = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] glance_num_retries = 3 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] glance_request_timeout = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] goodness_function = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] graceful_shutdown_timeout = 5 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] group_api_class = cinder.group.api.API {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] host = devstack {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] image_compress_on_upload = True {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] image_conversion_address_space_limit = 1 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] image_conversion_cpu_limit = 60 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] image_conversion_disable = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] image_upload_use_cinder_backend = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] image_upload_use_internal_tenant = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] image_volume_cache_enabled = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] image_volume_cache_max_count = 0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] image_volume_cache_max_size_gb = 0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] init_host_max_objects_retrieval = 0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] instance_format = [instance: %(uuid)s] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] iscsi_target_flags = {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] iscsi_write_cache = on {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] iser_helper = tgtadm {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] iser_ip_address = 192.168.122.6 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] iser_port = 3260 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] log_color = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] log_config_append = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] log_dir = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] log_file = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] log_options = True {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] log_rotate_interval = 1 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] log_rotate_interval_type = days {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] log_rotation_type = none {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] max_age = 0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] max_logfile_count = 30 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] max_logfile_size_mb = 200 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] max_over_subscription_ratio = 20.0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] message_reap_interval = 86400 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] message_ttl = 2592000 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] migration_create_volume_timeout_secs = 300 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] monkey_patch = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] monkey_patch_modules = [] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] my_ip = 192.168.122.6 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] no_snapshot_gb_quota = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] num_iser_scan_tries = 3 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] num_shell_tries = 3 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] num_volume_device_scan_tries = 3 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] nvmeof_conn_info_version = 1 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] nvmet_ns_id = 10 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] nvmet_port_id = 1 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] osapi_max_limit = 1000 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] osapi_volume_ext_list = [] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] osapi_volume_listen = 0.0.0.0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] osapi_volume_listen_port = 8776 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] osapi_volume_use_ssl = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] osapi_volume_workers = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] per_volume_size_limit = -1 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] periodic_fuzzy_delay = 60 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] periodic_interval = 60 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] project_id_regex = [0-9a-f\-]+ {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] public_endpoint = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] publish_errors = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] quota_backup_gigabytes = 1000 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] quota_backups = 10 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] quota_gigabytes = 1000 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] quota_groups = 10 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] quota_snapshots = 10 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] quota_volumes = 10 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] rate_limit_burst = 0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] rate_limit_except_level = CRITICAL {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] rate_limit_interval = 0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] reinit_driver_count = 3 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] replication_device = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] report_discard_supported = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] report_interval = 120 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] reservation_clean_interval = 86400 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] reservation_expire = 86400 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] reserved_image_namespaces = [] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] reserved_percentage = 0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] rpc_response_timeout = 120 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] run_external_periodic_tasks = True {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] scst_target_driver = iscsi {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] scst_target_iqn_name = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] service_down_time = 720 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] shell_completion = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] snapshot_name_template = snapshot-%s {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] split_loggers = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] state_path = /opt/stack/data/cinder {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] storage_availability_zone = nova {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] storage_protocol = iSCSI {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] syslog_log_facility = LOG_USER {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] target_helper = lioadm {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] target_ip_address = 192.168.122.6 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] target_port = 3260 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] target_protocol = iscsi {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] target_secondary_ip_addresses = [] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] trace_flags = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] transfer_api_class = cinder.transfer.api.API {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] transport_url = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] until_refresh = 0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] use_chap_auth = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] use_default_quota_class = True {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] use_journal = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] use_json = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] use_multipath_for_image_xfer = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] use_stderr = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] use_syslog = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] verify_glance_signatures = enabled {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] volume_api_class = cinder.volume.api.API {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] volume_backend_name = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] volume_clear = zero {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] volume_clear_ionice = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] volume_clear_size = 0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] volume_copy_bps_limit = 0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] volume_dd_blocksize = 1M {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] volume_name_template = volume-%s {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] volume_service_inithost_offload = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] volume_usage_audit_period = month {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] zoning_mode = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_concurrency.disable_process_locking = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.auth_section = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.auth_type = password {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.auth_version = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.cache = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.certfile = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.delay_auth_decision = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.http_connect_timeout = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.include_service_catalog = True {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.insecure = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.interface = public {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.keyfile = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.memcache_password = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.memcache_username = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.region_name = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.service_token_roles_required = True {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.service_type = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.token_cache_time = 300 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.6/identity {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.backend = dogpile.cache.null {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.backend_argument = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.backend_expiration_time = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.config_prefix = cache.oslo {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.debug_cache_backend = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.enable_retry_client = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.enable_socket_keepalive = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.enabled = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.expiration_time = 600 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.hashclient_retry_attempts = 2 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.memcache_dead_retry = 300 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.memcache_pool_maxsize = 10 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.memcache_sasl_enabled = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.password = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.proxies = [] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.redis_db = 0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.redis_sentinel_service_name = mymaster {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.redis_server = localhost:6379 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.retry_attempts = 2 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.retry_delay = 0.0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.socket_keepalive_count = 1 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.socket_keepalive_idle = 1 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.socket_keepalive_interval = 1 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.socket_timeout = 1.0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.tls_allowed_ciphers = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.tls_cafile = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.tls_certfile = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.tls_enabled = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.tls_keyfile = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cache.username = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] coordination.backend_url = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] database.asyncio_connection = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] database.asyncio_slave_connection = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] database.backend = sqlalchemy {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] database.connection = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] database.connection_debug = 0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] database.connection_parameters = {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] database.connection_recycle_time = 3600 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] database.connection_trace = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86980) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] database.db_inc_retry_interval = True {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] database.db_max_retries = 20 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] database.db_max_retry_interval = 10 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] database.db_retry_interval = 1 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] database.max_overflow = 50 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] database.max_pool_size = 5 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] database.max_retries = 10 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] database.mysql_wsrep_sync_wait = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] database.pool_timeout = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] database.retry_interval = 10 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] database.slave_connection = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] database.sqlite_synchronous = True {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] database.synchronous_reader = True {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] database.use_db_reconnect = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_tracing.insecure = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] profiler.connection_string = messaging:// {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] profiler.enabled = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] profiler.es_doc_type = notification {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] profiler.es_scroll_size = 10000 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] profiler.es_scroll_time = 2m {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] profiler.filter_error_trace = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] profiler.hmac_keys = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] profiler.sentinel_service_name = mymaster {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] profiler.socket_timeout = 0.1 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] profiler.trace_requests = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] profiler.trace_sqlalchemy = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] profiler_jaeger.process_tags = {} {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] profiler_jaeger.service_name_prefix = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] profiler_otlp.service_name_prefix = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_policy.enforce_new_defaults = True {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_policy.policy_default_rule = default {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_policy.policy_file = policy.yaml {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_policy.remote_timeout = 60.0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] privsep_osbrick.group = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] privsep_osbrick.helper_command = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] privsep_osbrick.user = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cinder_sys_admin.group = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cinder_sys_admin.helper_command = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] cinder_sys_admin.user = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] service_user.auth_section = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] service_user.auth_type = password {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] service_user.cafile = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] service_user.certfile = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] service_user.collect_timing = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] service_user.insecure = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] service_user.keyfile = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] service_user.send_service_user_token = True {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] service_user.split_loggers = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] service_user.timeout = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] service_user.tls_ciphers = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] service_user.tls_min_version = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] glance.auth_section = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] glance.auth_type = password {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] glance.certfile = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] glance.collect_timing = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] glance.insecure = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] glance.keyfile = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] glance.region_name = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] glance.split_loggers = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] glance.timeout = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] glance.tls_ciphers = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] glance.tls_min_version = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.backend_availability_zone = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.chap_password = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.chap_username = {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.disk_geometry = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.driver_client_cert = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.driver_client_cert_key = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.driver_data_namespace = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.driver_use_ssl = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.enable_unsupported_driver = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.extra_capabilities = {} {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.filter_function = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.goodness_function = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.iscsi_target_flags = {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.iscsi_write_cache = on {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.iser_helper = tgtadm {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.iser_ip_address = 192.168.122.6 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.iser_port = 3260 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.nas_host = {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.nas_login = admin {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.nas_mount_options = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.nas_password = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.nas_private_key = {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.nas_share_path = {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.nas_ssh_port = 22 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.num_shell_tries = 3 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.nvmet_port_id = 1 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.quobyte_client_cfg = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.quobyte_volume_url = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.replication_device = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.report_discard_supported = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.reserved_percentage = 0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.scst_target_driver = iscsi {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.scst_target_iqn_name = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.storage_protocol = iSCSI {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.target_helper = tgtadm {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.target_ip_address = 192.168.122.6 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.target_port = 3260 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.target_protocol = iscsi {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.trace_flags = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.unique_fqdn_network = True {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.use_chap_auth = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.volume_backend_name = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.volume_clear = zero {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.volume_clear_ionice = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.volume_clear_size = 0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_reports.file_event_handler = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_reports.log_dir = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.backend_availability_zone = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.backend_host = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.chap_password = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.chap_username = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.chiscsi_conf = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.disk_geometry = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.driver_client_cert = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.driver_client_cert_key = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.driver_data_namespace = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.driver_use_ssl = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.extra_capabilities = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.filter_function = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.goodness_function = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.iscsi_target_flags = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.iscsi_write_cache = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.iser_helper = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.iser_ip_address = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.iser_port = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.iser_target_prefix = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.nas_host = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.nas_login = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.nas_mount_options = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.nas_password = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.nas_private_key = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.nas_share_path = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.nas_ssh_port = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.num_shell_tries = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.nvmet_ns_id = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.nvmet_port_id = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86980) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 07 13:42:33 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.quobyte [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 07 13:42:33 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.quobyte [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.replication_device = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.report_discard_supported = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Running cmd (subprocess): mount.quobyte {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.reserved_percentage = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.scst_target_driver = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.storage_protocol = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.target_helper = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.target_ip_address = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.target_port = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.target_prefix = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.target_protocol = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.trace_flags = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.unique_fqdn_network = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.use_chap_auth = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.volume_clear = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.volume_clear_ionice = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.volume_clear_size = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] QuobyteHD.volumes_dir = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.ssl = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.ssl_version = {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_notifications.driver = [] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_notifications.retry = -1 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] oslo_messaging_notifications.transport_url = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] key_manager.fixed_key = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican.barbican_api_version = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican.barbican_endpoint = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican.barbican_endpoint_type = public {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican.barbican_region_name = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican.cafile = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican.certfile = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican.collect_timing = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican.insecure = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican.keyfile = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican.number_of_retries = 60 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican.retry_delay = 1 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican.send_service_user_token = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican.split_loggers = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican.timeout = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican.tls_ciphers = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican.tls_min_version = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican.verify_ssl = True {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican.verify_ssl_path = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican_service_user.auth_section = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican_service_user.auth_type = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican_service_user.cafile = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican_service_user.certfile = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican_service_user.collect_timing = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican_service_user.insecure = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican_service_user.keyfile = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican_service_user.split_loggers = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican_service_user.timeout = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican_service_user.tls_ciphers = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] barbican_service_user.tls_min_version = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] vault.approle_role_id = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] vault.approle_secret_id = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] vault.auth_method = approle {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] vault.auth_path = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] vault.kv_mountpoint = secret {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] vault.kv_path = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] vault.kv_version = 2 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] vault.namespace = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] vault.root_token_id = **** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] vault.ssl_ca_crt_file = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] vault.timeout = 60.0 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] vault.token_file = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] vault.token_role = None {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] vault.use_ssl = False {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:33 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] ******************************************************************************** {{(pid=86765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 13:42:33 devstack quobyte-client[86981]: Reading configuration file: /etc/quobyte/client.cfg Sep 07 13:42:33 devstack quobyte-client[86981]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 07 13:42:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] CMD "mount.quobyte" returned: 1 in 0.118s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:42:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:42:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:42:33 devstack cinder-volume[86980]: INFO cinder.volume.drivers.quobyte [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 ... Sep 07 13:42:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 -c /etc/quobyte/client-cinder.cfg {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:33 devstack sudo[86986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 -c /etc/quobyte/client-cinder.cfg Sep 07 13:42:33 devstack sudo[86986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:33 devstack sudo[86986]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.397s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:33 devstack cinder-volume[86980]: INFO cinder.volume.drivers.quobyte [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 succeeded Sep 07 13:42:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:42:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.411s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:42:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:33 devstack sudo[87055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:42:33 devstack sudo[87055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:34 devstack sudo[87055]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.229s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:34 devstack cinder-volume[86980]: INFO cinder.volume.driver [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Driver hasn't implemented _init_vendor_properties() Sep 07 13:42:34 devstack cinder-volume[86980]: DEBUG cinder.volume.driver [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5802955627441, 'free_capacity_gb': 1773.5802955627441, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86980) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 13:42:34 devstack cinder-volume[86980]: DEBUG oslo_db.sqlalchemy.engines [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86980) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:42:34 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writer thread running {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 13:42:34 devstack cinder-volume[86980]: DEBUG cinder.db.api [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Building query based on filter {{(pid=86980) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 13:42:34 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86980) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 13:42:34 devstack cinder-volume[86980]: INFO cinder.keymgr.migration [None req-ac7e410f-5e2b-4773-addd-a0e98449c416 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 13:42:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:42:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:42:34 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:42:34 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:42:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:42:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:34 devstack sudo[87059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:42:34 devstack sudo[87059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:34 devstack sudo[87059]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.221s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:34 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:42:34 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Driver initialization completed successfully. Sep 07 13:42:34 devstack cinder-volume[86980]: INFO cinder.manager [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Initiating service 3 cleanup Sep 07 13:42:34 devstack cinder-volume[86980]: INFO cinder.manager [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Service 3 cleanup completed. Sep 07 13:42:34 devstack cinder-volume[86980]: DEBUG cinder.service [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Creating RPC server for service cinder-volume {{(pid=86980) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 13:42:34 devstack cinder-volume[86980]: DEBUG cinder.service [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86980) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 13:42:34 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 07 13:42:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:42:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:42:34 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:42:34 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:42:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:42:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:34 devstack sudo[87062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:42:34 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:34 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.240s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:34 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-b6eede68-6032-4e2b-941e-211a2a0e19e3 None None] Driver post RPC initialization completed successfully. Sep 07 13:42:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5fa2b3e3-f78f-4bd8-94c5-92e2bee2b46f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:42:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5fa2b3e3-f78f-4bd8-94c5-92e2bee2b46f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:42:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-5fa2b3e3-f78f-4bd8-94c5-92e2bee2b46f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:42:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-5fa2b3e3-f78f-4bd8-94c5-92e2bee2b46f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:42:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5fa2b3e3-f78f-4bd8-94c5-92e2bee2b46f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:42:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5fa2b3e3-f78f-4bd8-94c5-92e2bee2b46f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:39 devstack cinder-volume[86765]: INFO oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] Caught SIGTERM, stopping children Sep 07 13:42:39 devstack cinder-volume[86765]: DEBUG oslo_concurrency.lockutils [None req-002c8830-89c4-41b8-b752-27040120239f None None] Acquiring lock "singleton_lock" {{(pid=86765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 13:42:39 devstack cinder-volume[86765]: DEBUG oslo_concurrency.lockutils [None req-002c8830-89c4-41b8-b752-27040120239f None None] Acquired lock "singleton_lock" {{(pid=86765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 13:42:39 devstack cinder-volume[86765]: DEBUG oslo_concurrency.lockutils [None req-002c8830-89c4-41b8-b752-27040120239f None None] Releasing lock "singleton_lock" {{(pid=86765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 13:42:39 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] Stop services. {{(pid=86765) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 07 13:42:39 devstack cinder-volume[86765]: DEBUG oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] Killing children. {{(pid=86765) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 07 13:42:39 devstack cinder-volume[86765]: INFO oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] Waiting on 1 children to exit Sep 07 13:42:39 devstack sudo[87254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:42:39 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:40 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5fa2b3e3-f78f-4bd8-94c5-92e2bee2b46f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.544s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:40 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-5fa2b3e3-f78f-4bd8-94c5-92e2bee2b46f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5fa2b3e3-f78f-4bd8-94c5-92e2bee2b46f None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5fa2b3e3-f78f-4bd8-94c5-92e2bee2b46f None None] Unable to connect to AMQP server on 192.168.122.6:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server [None req-5fa2b3e3-f78f-4bd8-94c5-92e2bee2b46f None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.6:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server method() Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1560, in _publish Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server self._producer.publish( Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server return _publish( Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server listener(*args) Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server raise error_for_code( Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server self.transport._send( Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1679, in fanout_send Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1509, in _ensure_publishing Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1131, in ensure Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.6:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 07 13:42:40 devstack cinder-volume[86980]: ERROR oslo_messaging.rpc.server Sep 07 13:42:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-002c8830-89c4-41b8-b752-27040120239f None None] Acquiring lock "singleton_lock" {{(pid=86980) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 13:42:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-002c8830-89c4-41b8-b752-27040120239f None None] Acquired lock "singleton_lock" {{(pid=86980) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 13:42:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-002c8830-89c4-41b8-b752-27040120239f None None] Releasing lock "singleton_lock" {{(pid=86980) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 13:42:42 devstack cinder-volume[86980]: WARNING amqp [None req-002c8830-89c4-41b8-b752-27040120239f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 13:42:42 devstack cinder-volume[86980]: WARNING amqp [None req-002c8830-89c4-41b8-b752-27040120239f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 13:42:42 devstack cinder-volume[86765]: INFO oslo_service.backend._eventlet.service [None req-002c8830-89c4-41b8-b752-27040120239f None None] Child 86980 exited with status 0 Sep 07 13:42:43 devstack cinder-volume[87270]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 13:42:43 devstack cinder-volume[87270]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 13:42:43 devstack cinder-volume[87270]: we strongly recommend against using it for new projects. Sep 07 13:42:43 devstack cinder-volume[87270]: If you are already using Eventlet, we recommend migrating to a different Sep 07 13:42:43 devstack cinder-volume[87270]: framework. For more detail see Sep 07 13:42:43 devstack cinder-volume[87270]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 13:42:43 devstack cinder-volume[87270]: import eventlet # noqa Sep 07 13:42:46 devstack cinder-volume[87270]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87270) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 13:42:46 devstack cinder-volume[87270]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87270) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 13:42:46 devstack cinder-volume[87270]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87270) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 13:42:47 devstack cinder-volume[87270]: INFO dbcounter [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] Registered counter for database cinder Sep 07 13:42:47 devstack cinder-volume[87270]: DEBUG oslo_db.sqlalchemy.engines [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87270) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:42:47 devstack cinder-volume[87270]: DEBUG dbcounter [-] [87270] Writer thread running {{(pid=87270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 13:42:47 devstack cinder-volume[87270]: INFO cinder.rpc [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 13:42:47 devstack cinder-volume[87270]: INFO cinder.rpc [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 13:42:47 devstack cinder-volume[87270]: DEBUG oslo_db.sqlalchemy.engines [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87270) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:42:47 devstack cinder-volume[87270]: INFO cinder.volume.manager [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] Determined volume DB was empty at startup. Sep 07 13:42:47 devstack cinder-volume[87270]: DEBUG cinder.volume.manager [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87270) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 13:42:47 devstack cinder-volume[87270]: WARNING stevedore.named [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 13:42:47 devstack cinder-volume[87270]: WARNING castellan.key_manager [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 13:42:47 devstack cinder-volume[87270]: WARNING cinder.keymgr.conf_key_mgr [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 13:42:47 devstack cinder-volume[87270]: INFO cinder.volume.manager [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_db.sqlalchemy.engines [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87270) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:42:48 devstack cinder-volume[87270]: INFO oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] Starting 1 workers Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] Started child 87571 {{(pid=87270) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] Full set of CONF: {{(pid=87270) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] ******************************************************************************** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] Configuration options gathered from: {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] ================================================================================ {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] allow_availability_zone_fallback = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] allow_compression_on_image_upload = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] allowed_direct_url_schemes = [] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] api_rate_limit = True {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] auth_strategy = keystone {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_availability_zone = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_host = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_name = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_stats_polling_interval = 60 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backup_api_class = cinder.backup.api.API {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backup_name_template = backup-%s {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backup_use_same_host = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backup_use_temp_snapshot = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] chap_password = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] chap_username = {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cinder_internal_tenant_project_id = 33a596cf3bbb44b2847320b8dcfdb3be {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87571]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cinder_internal_tenant_user_id = 8b944e4266aa4bd5affa88261549ebb1 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cluster = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] compression_format = gzip {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] compute_api_class = cinder.compute.nova.API {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] config_dir = [] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] config_source = [] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] control_exchange = openstack {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] debug = True {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] default_availability_zone = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] default_group_type = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] default_volume_type = QuobyteHD {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] disk_geometry = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] driver_client_cert = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] driver_client_cert_key = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] driver_data_namespace = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] driver_ssl_cert_path = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] driver_ssl_cert_verify = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] driver_use_ssl = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] enable_new_services = True {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] enable_unsupported_driver = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] enabled_backends = ['QuobyteHD'] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] enforce_multipath_for_image_xfer = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] filter_function = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] glance_api_insecure = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] glance_api_servers = ['http://192.168.122.6/image'] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] glance_api_ssl_compression = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] glance_ca_certificates_file = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] glance_catalog_info = image:glance:publicURL {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] glance_certfile = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] glance_keyfile = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] glance_num_retries = 3 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] glance_request_timeout = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] goodness_function = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] graceful_shutdown_timeout = 5 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] group_api_class = cinder.group.api.API {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] host = devstack {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] image_compress_on_upload = True {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] image_conversion_address_space_limit = 1 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] image_conversion_cpu_limit = 60 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] image_conversion_disable = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] image_upload_use_cinder_backend = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] image_upload_use_internal_tenant = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] image_volume_cache_enabled = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] image_volume_cache_max_count = 0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] image_volume_cache_max_size_gb = 0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] init_host_max_objects_retrieval = 0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] instance_format = [instance: %(uuid)s] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] iscsi_target_flags = {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] iscsi_write_cache = on {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] iser_helper = tgtadm {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] iser_ip_address = 192.168.122.6 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] iser_port = 3260 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] log_color = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] log_config_append = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] log_dir = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] log_file = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] log_options = True {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] log_rotate_interval = 1 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] log_rotate_interval_type = days {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] log_rotation_type = none {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] max_age = 0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] max_logfile_count = 30 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] max_logfile_size_mb = 200 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] max_over_subscription_ratio = 20.0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] message_reap_interval = 86400 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] message_ttl = 2592000 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] migration_create_volume_timeout_secs = 300 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] monkey_patch = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] monkey_patch_modules = [] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] my_ip = 192.168.122.6 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] no_snapshot_gb_quota = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] num_iser_scan_tries = 3 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] num_shell_tries = 3 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] num_volume_device_scan_tries = 3 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] nvmeof_conn_info_version = 1 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] nvmet_ns_id = 10 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] nvmet_port_id = 1 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] osapi_max_limit = 1000 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] osapi_volume_ext_list = [] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] osapi_volume_listen = 0.0.0.0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] osapi_volume_listen_port = 8776 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] osapi_volume_use_ssl = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] osapi_volume_workers = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] per_volume_size_limit = -1 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] periodic_fuzzy_delay = 60 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] periodic_interval = 60 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] project_id_regex = [0-9a-f\-]+ {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] public_endpoint = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] publish_errors = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] quota_backup_gigabytes = 1000 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] quota_backups = 10 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] quota_gigabytes = 1000 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] quota_groups = 10 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] quota_snapshots = 10 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] quota_volumes = 10 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] rate_limit_burst = 0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] rate_limit_except_level = CRITICAL {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] rate_limit_interval = 0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] reinit_driver_count = 3 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] replication_device = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] report_discard_supported = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] report_interval = 120 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] reservation_clean_interval = 86400 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] reservation_expire = 86400 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] reserved_image_namespaces = [] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] reserved_percentage = 0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] rpc_response_timeout = 120 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] run_external_periodic_tasks = True {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] scst_target_driver = iscsi {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] scst_target_iqn_name = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] service_down_time = 720 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] shell_completion = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] snapshot_name_template = snapshot-%s {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] split_loggers = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] state_path = /opt/stack/data/cinder {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] storage_availability_zone = nova {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Starting volume driver QuobyteDriver (1.2.1) Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] storage_protocol = iSCSI {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87571) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] syslog_log_facility = LOG_USER {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] target_helper = lioadm {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] target_ip_address = 192.168.122.6 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] target_port = 3260 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] target_protocol = iscsi {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] target_secondary_ip_addresses = [] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] trace_flags = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] transfer_api_class = cinder.transfer.api.API {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] transport_url = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] until_refresh = 0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] use_chap_auth = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] use_default_quota_class = True {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] use_journal = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] use_json = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] use_multipath_for_image_xfer = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] use_stderr = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] use_syslog = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] verify_glance_signatures = enabled {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] volume_api_class = cinder.volume.api.API {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] volume_backend_name = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] volume_clear = zero {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] volume_clear_ionice = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] volume_clear_size = 0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] volume_copy_bps_limit = 0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] volume_dd_blocksize = 1M {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] volume_name_template = volume-%s {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] volume_service_inithost_offload = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] volume_usage_audit_period = month {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] zoning_mode = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_concurrency.disable_process_locking = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.auth_section = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.auth_type = password {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.auth_version = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.cache = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.certfile = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.delay_auth_decision = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.http_connect_timeout = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.include_service_catalog = True {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.insecure = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.interface = public {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.keyfile = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.memcache_password = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.memcache_username = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.region_name = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.service_token_roles_required = True {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.service_type = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.token_cache_time = 300 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.6/identity {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.backend = dogpile.cache.null {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.backend_argument = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.backend_expiration_time = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.config_prefix = cache.oslo {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.debug_cache_backend = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.enable_retry_client = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.enable_socket_keepalive = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.enabled = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.expiration_time = 600 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.hashclient_retry_attempts = 2 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.memcache_dead_retry = 300 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.memcache_pool_maxsize = 10 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.memcache_sasl_enabled = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.password = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.proxies = [] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.redis_db = 0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.redis_sentinel_service_name = mymaster {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.redis_server = localhost:6379 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.retry_attempts = 2 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.retry_delay = 0.0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.socket_keepalive_count = 1 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.socket_keepalive_idle = 1 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.socket_keepalive_interval = 1 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.socket_timeout = 1.0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.tls_allowed_ciphers = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.tls_cafile = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.tls_certfile = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.tls_enabled = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.tls_keyfile = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cache.username = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] coordination.backend_url = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] database.asyncio_connection = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] database.asyncio_slave_connection = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] database.backend = sqlalchemy {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] database.connection = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] database.connection_debug = 0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] database.connection_parameters = {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] database.connection_recycle_time = 3600 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] database.connection_trace = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] database.db_inc_retry_interval = True {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] database.db_max_retries = 20 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] database.db_max_retry_interval = 10 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] database.db_retry_interval = 1 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] database.max_overflow = 50 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] database.max_pool_size = 5 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] database.max_retries = 10 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] database.mysql_wsrep_sync_wait = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] database.pool_timeout = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] database.retry_interval = 10 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] database.slave_connection = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] database.sqlite_synchronous = True {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] database.synchronous_reader = True {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] database.use_db_reconnect = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87571) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 07 13:42:48 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.quobyte [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 07 13:42:48 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.quobyte [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_tracing.insecure = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] profiler.connection_string = messaging:// {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Running cmd (subprocess): mount.quobyte {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] profiler.enabled = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] profiler.es_doc_type = notification {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] profiler.es_scroll_size = 10000 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] profiler.es_scroll_time = 2m {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] profiler.filter_error_trace = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] profiler.hmac_keys = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] profiler.sentinel_service_name = mymaster {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] profiler.socket_timeout = 0.1 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] profiler.trace_requests = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] profiler.trace_sqlalchemy = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] profiler_jaeger.process_tags = {} {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] profiler_jaeger.service_name_prefix = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] profiler_otlp.service_name_prefix = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_policy.enforce_new_defaults = True {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_policy.policy_default_rule = default {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_policy.policy_file = policy.yaml {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_policy.remote_timeout = 60.0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] privsep_osbrick.group = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] privsep_osbrick.helper_command = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] privsep_osbrick.user = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cinder_sys_admin.group = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cinder_sys_admin.helper_command = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] cinder_sys_admin.user = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] service_user.auth_section = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] service_user.auth_type = password {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] service_user.cafile = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] service_user.certfile = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] service_user.collect_timing = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] service_user.insecure = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] service_user.keyfile = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] service_user.send_service_user_token = True {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] service_user.split_loggers = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] service_user.timeout = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] service_user.tls_ciphers = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] service_user.tls_min_version = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] glance.auth_section = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] glance.auth_type = password {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] glance.certfile = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] glance.collect_timing = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] glance.insecure = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] glance.keyfile = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] glance.region_name = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] glance.split_loggers = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] glance.timeout = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] glance.tls_ciphers = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] glance.tls_min_version = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.backend_availability_zone = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.chap_password = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.chap_username = {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.disk_geometry = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.driver_client_cert = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.driver_client_cert_key = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.driver_data_namespace = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.driver_use_ssl = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.enable_unsupported_driver = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.extra_capabilities = {} {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.filter_function = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.goodness_function = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.iscsi_target_flags = {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.iscsi_write_cache = on {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.iser_helper = tgtadm {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.iser_ip_address = 192.168.122.6 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.iser_port = 3260 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.nas_host = {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.nas_login = admin {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.nas_mount_options = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.nas_password = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.nas_private_key = {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.nas_share_path = {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.nas_ssh_port = 22 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.num_shell_tries = 3 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack quobyte-client[87572]: Reading configuration file: /etc/quobyte/client.cfg Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack quobyte-client[87572]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.nvmet_port_id = 1 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.quobyte_client_cfg = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] CMD "mount.quobyte" returned: 1 in 0.050s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.quobyte_volume_url = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.replication_device = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.report_discard_supported = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.reserved_percentage = 0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.scst_target_driver = iscsi {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.scst_target_iqn_name = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.storage_protocol = iSCSI {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.target_helper = tgtadm {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.target_ip_address = 192.168.122.6 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.target_port = 3260 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.target_protocol = iscsi {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.trace_flags = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.unique_fqdn_network = True {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.use_chap_auth = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.volume_backend_name = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.volume_clear = zero {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.volume_clear_ionice = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.volume_clear_size = 0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_reports.file_event_handler = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_reports.log_dir = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.backend_availability_zone = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.backend_host = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.chap_password = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.chap_username = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.chiscsi_conf = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.disk_geometry = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.driver_client_cert = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.driver_client_cert_key = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.driver_data_namespace = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.driver_use_ssl = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.extra_capabilities = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.filter_function = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.goodness_function = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.iscsi_target_flags = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.iscsi_write_cache = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.iser_helper = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.iser_ip_address = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.iser_port = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.iser_target_prefix = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.nas_host = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack sudo[87573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.nas_login = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.nas_mount_options = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.nas_password = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.nas_private_key = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.nas_share_path = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.nas_ssh_port = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.num_shell_tries = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.nvmet_ns_id = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.nvmet_port_id = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.replication_device = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.report_discard_supported = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.reserved_percentage = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.scst_target_driver = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.storage_protocol = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.target_helper = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.target_ip_address = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.target_port = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.target_prefix = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.target_protocol = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.trace_flags = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.unique_fqdn_network = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.use_chap_auth = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.volume_clear = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.volume_clear_ionice = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.volume_clear_size = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] QuobyteHD.volumes_dir = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.ssl = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.ssl_version = {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_notifications.driver = [] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_notifications.retry = -1 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] oslo_messaging_notifications.transport_url = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] key_manager.fixed_key = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican.barbican_api_version = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican.barbican_endpoint = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican.barbican_endpoint_type = public {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican.barbican_region_name = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican.cafile = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican.certfile = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican.collect_timing = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican.insecure = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican.keyfile = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican.number_of_retries = 60 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican.retry_delay = 1 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican.send_service_user_token = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican.split_loggers = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican.timeout = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican.tls_ciphers = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican.tls_min_version = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican.verify_ssl = True {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican.verify_ssl_path = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican_service_user.auth_section = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican_service_user.auth_type = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican_service_user.cafile = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican_service_user.certfile = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican_service_user.collect_timing = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican_service_user.insecure = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican_service_user.keyfile = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican_service_user.split_loggers = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican_service_user.timeout = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican_service_user.tls_ciphers = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] barbican_service_user.tls_min_version = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] vault.approle_role_id = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] vault.approle_secret_id = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] vault.auth_method = approle {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] vault.auth_path = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] vault.kv_mountpoint = secret {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] vault.kv_path = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] vault.kv_version = 2 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] vault.namespace = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] vault.root_token_id = **** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] vault.ssl_ca_crt_file = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] vault.timeout = 60.0 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] vault.token_file = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] vault.token_role = None {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] vault.use_ssl = False {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:42:48 devstack cinder-volume[87270]: DEBUG oslo_service.backend._eventlet.service [None req-afd5de7c-f0ae-4b7d-9487-db15fd50043e None None] ******************************************************************************** {{(pid=87270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 13:42:48 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.243s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:48 devstack cinder-volume[87571]: INFO cinder.volume.driver [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Driver hasn't implemented _init_vendor_properties() Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG cinder.volume.driver [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5802955627441, 'free_capacity_gb': 1773.5802955627441, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87571) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG oslo_db.sqlalchemy.engines [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87571) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writer thread running {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG cinder.db.api [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Building query based on filter {{(pid=87571) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87571) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:48 devstack cinder-volume[87571]: INFO cinder.keymgr.migration [None req-e6d34e18-d357-4ce3-854c-d05aca1482fa None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 13:42:48 devstack sudo[87584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:42:48 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:48 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.229s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:42:48 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Driver initialization completed successfully. Sep 07 13:42:48 devstack cinder-volume[87571]: INFO cinder.manager [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Initiating service 3 cleanup Sep 07 13:42:48 devstack cinder-volume[87571]: INFO cinder.manager [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Service 3 cleanup completed. Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG cinder.service [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Creating RPC server for service cinder-volume {{(pid=87571) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 13:42:48 devstack cinder-volume[87571]: DEBUG cinder.service [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87571) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 13:42:49 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 07 13:42:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:42:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:42:49 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:42:49 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:42:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:42:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:49 devstack sudo[87597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:42:49 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:49 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.249s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:49 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c0af72e3-7e65-4639-b580-f0750f04003b None None] Driver post RPC initialization completed successfully. Sep 07 13:42:58 devstack cinder-volume[87270]: DEBUG dbcounter [-] [87270] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:42:58 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:42:59 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=4 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:43:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager._thread_info {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:43:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread count: 6 {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:43:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread info: [<_MainThread(MainThread, started 132147689414784)>, , , , , ] {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:43:47 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:43:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Flow 'volume_create_manager' (cd053ccf-2201-4aaf-a0b3-d6a9f31a1581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:43:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b395b278-5578-4798-94fa-51bc62b9358f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b395b278-5578-4798-94fa-51bc62b9358f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2120463409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2069213f-af3f-4a2d-8493-2702138101cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b18dbabd36624069b67f550afbaa2ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:43:47Z,use_quota=True,user_id='6e65637d0fdd4f20b3c888e38e736a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b788a1de-497f-430c-9c87-3af3595ad951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b788a1de-497f-430c-9c87-3af3595ad951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4baeb267-4e9b-486e-8a6c-3fd550f588dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4baeb267-4e9b-486e-8a6c-3fd550f588dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2069213f-af3f-4a2d-8493-2702138101cf', 'volume_name': 'volume-2069213f-af3f-4a2d-8493-2702138101cf', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f475e587-e919-4f54-84d0-e2d942a7d2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f475e587-e919-4f54-84d0-e2d942a7d2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5934e859-c11e-4d19-b56e-7209edbf9ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:47 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Volume 2069213f-af3f-4a2d-8493-2702138101cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2069213f-af3f-4a2d-8493-2702138101cf', 'volume_size': 1} Sep 07 13:43:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2120463409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2069213f-af3f-4a2d-8493-2702138101cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b18dbabd36624069b67f550afbaa2ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:43:47Z,use_quota=True,user_id='6e65637d0fdd4f20b3c888e38e736a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:43:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Creating volume 2069213f-af3f-4a2d-8493-2702138101cf {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:43:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:43:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:43:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:43:47 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:43:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2069213f-af3f-4a2d-8493-2702138101cf 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:47 devstack sudo[88090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2069213f-af3f-4a2d-8493-2702138101cf 1073741824 Sep 07 13:43:47 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:48 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2069213f-af3f-4a2d-8493-2702138101cf 1073741824" returned: 0 in 0.868s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2069213f-af3f-4a2d-8493-2702138101cf {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:48 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2069213f-af3f-4a2d-8493-2702138101cf Sep 07 13:43:48 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:48 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2069213f-af3f-4a2d-8493-2702138101cf" returned: 0 in 0.441s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:43:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5934e859-c11e-4d19-b56e-7209edbf9ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2069213f-af3f-4a2d-8493-2702138101cf', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131062bd-c4a6-4f25-8bef-56f9733d765e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:48 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Volume volume-2069213f-af3f-4a2d-8493-2702138101cf (2069213f-af3f-4a2d-8493-2702138101cf): created successfully Sep 07 13:43:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131062bd-c4a6-4f25-8bef-56f9733d765e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Flow 'volume_create_manager' (cd053ccf-2201-4aaf-a0b3-d6a9f31a1581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:43:48 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-4af5a257-81c6-4fbf-a621-caa76e7f1850 tempest-TaggedAttachmentsTest-1337864321 None] Created volume successfully. Sep 07 13:43:51 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:43:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Flow 'volume_create_manager' (8ed15f10-f2ed-491f-869c-fb2836bb08e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:43:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401c41e9-77a5-42b7-99bb-752d2a462b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401c41e9-77a5-42b7-99bb-752d2a462b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-970900953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7085249d-e12c-424a-b253-47bd482ec198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b613ba2d3e148b3bad68adce5946960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:43:51Z,use_quota=True,user_id='0c258ca7d9a44a78b301b4fa960482c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e3e5e8-002a-4aba-af62-5de08c7da919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e3e5e8-002a-4aba-af62-5de08c7da919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d421243-d0ad-4228-8508-bcdaf462d618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d421243-d0ad-4228-8508-bcdaf462d618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7085249d-e12c-424a-b253-47bd482ec198', 'volume_name': 'volume-7085249d-e12c-424a-b253-47bd482ec198', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44528858-f928-44a0-ba88-eb3591d59c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44528858-f928-44a0-ba88-eb3591d59c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08462c39-7c21-4c4b-8164-46f48023c099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:51 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Volume 7085249d-e12c-424a-b253-47bd482ec198: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7085249d-e12c-424a-b253-47bd482ec198', 'volume_size': 1} Sep 07 13:43:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-970900953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7085249d-e12c-424a-b253-47bd482ec198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b613ba2d3e148b3bad68adce5946960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:43:51Z,use_quota=True,user_id='0c258ca7d9a44a78b301b4fa960482c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:43:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Creating volume 7085249d-e12c-424a-b253-47bd482ec198 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:43:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:43:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:43:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:43:51 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:43:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7085249d-e12c-424a-b253-47bd482ec198 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:51 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7085249d-e12c-424a-b253-47bd482ec198 1073741824 Sep 07 13:43:51 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:52 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7085249d-e12c-424a-b253-47bd482ec198 1073741824" returned: 0 in 0.912s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7085249d-e12c-424a-b253-47bd482ec198 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:52 devstack sudo[88475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7085249d-e12c-424a-b253-47bd482ec198 Sep 07 13:43:52 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:53 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7085249d-e12c-424a-b253-47bd482ec198" returned: 0 in 0.512s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:43:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08462c39-7c21-4c4b-8164-46f48023c099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7085249d-e12c-424a-b253-47bd482ec198', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20220f5b-e669-424e-8eae-494d0662a537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:53 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Volume volume-7085249d-e12c-424a-b253-47bd482ec198 (7085249d-e12c-424a-b253-47bd482ec198): created successfully Sep 07 13:43:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20220f5b-e669-424e-8eae-494d0662a537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Flow 'volume_create_manager' (8ed15f10-f2ed-491f-869c-fb2836bb08e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:43:53 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-fddfd6a2-7a90-47e2-8128-e00a730160f8 tempest-DeleteServersTestJSON-1870656517 None] Created volume successfully. Sep 07 13:43:58 devstack cinder-volume[87571]: WARNING py.warnings [req-eb77424e-8c38-468b-96de-106223f73fff req-08e27512-2801-4180-a1ab-550fe97f7ed0 tempest-DeleteServersTestJSON-1870656517 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 07 13:43:58 devstack cinder-volume[87571]: .first() Sep 07 13:43:58 devstack cinder-volume[87571]: Sep 07 13:43:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-eb77424e-8c38-468b-96de-106223f73fff req-08e27512-2801-4180-a1ab-550fe97f7ed0 tempest-DeleteServersTestJSON-1870656517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-eb77424e-8c38-468b-96de-106223f73fff req-08e27512-2801-4180-a1ab-550fe97f7ed0 tempest-DeleteServersTestJSON-1870656517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-eb77424e-8c38-468b-96de-106223f73fff req-08e27512-2801-4180-a1ab-550fe97f7ed0 tempest-DeleteServersTestJSON-1870656517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-eb77424e-8c38-468b-96de-106223f73fff req-08e27512-2801-4180-a1ab-550fe97f7ed0 tempest-DeleteServersTestJSON-1870656517 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285', 'name': 'volume-7085249d-e12c-424a-b253-47bd482ec198', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3bb446ab-54f6-46ca-acc3-d6a8951e65fe', 'enforce_multipath': True} {{(pid=87571) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:43:59 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-eb77424e-8c38-468b-96de-106223f73fff req-08e27512-2801-4180-a1ab-550fe97f7ed0 tempest-DeleteServersTestJSON-1870656517 None] attachment_update completed successfully. Sep 07 13:44:06 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-cab877ff-cb5e-407c-8689-7fa844452e3f req-3ef72533-5e6e-481b-a5e1-742a15401d8b tempest-DeleteServersTestJSON-1870656517 None] Terminate volume connection completed successfully. Sep 07 13:44:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-cab877ff-cb5e-407c-8689-7fa844452e3f req-3ef72533-5e6e-481b-a5e1-742a15401d8b tempest-DeleteServersTestJSON-1870656517 None] Deleting attachment 3bb446ab-54f6-46ca-acc3-d6a8951e65fe. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:44:09 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:UPDATE=8,cinder:DELETE=1,cinder:SELECT=8,cinder:INSERT=1 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:44:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] Acquiring lock "cinder-7085249d-e12c-424a-b253-47bd482ec198-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:44:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] Lock "cinder-7085249d-e12c-424a-b253-47bd482ec198-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:44:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] Acquiring lock "cinder-quobyte-7085249d-e12c-424a-b253-47bd482ec198" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:44:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] Lock "cinder-quobyte-7085249d-e12c-424a-b253-47bd482ec198" acquired by "delete_volume" :: waited 0.027s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:44:09 devstack cinder-volume[87571]: INFO oslo.privsep.daemon [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpc3qxha6o/privsep.sock'] Sep 07 13:44:09 devstack sudo[89120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpc3qxha6o/privsep.sock Sep 07 13:44:09 devstack sudo[89120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:10 devstack cinder-volume[87571]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 07 13:44:10 devstack cinder-volume[87571]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 13:44:10 devstack cinder-volume[87571]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 07 13:44:10 devstack cinder-volume[87571]: WARNING oslo.privsep.daemon [-] privsep log: Sep 07 13:44:10 devstack cinder-volume[87571]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 07 13:44:10 devstack cinder-volume[87571]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 07 13:44:10 devstack cinder-volume[87571]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 13:44:10 devstack cinder-volume[87571]: WARNING oslo.privsep.daemon [-] privsep log: Sep 07 13:44:10 devstack cinder-volume[87571]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 07 13:44:11 devstack sudo[89120]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:11 devstack cinder-volume[87571]: INFO oslo.privsep.daemon [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] Spawned new privsep daemon via rootwrap Sep 07 13:44:11 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] Accepted privsep connection to /tmp/tmpc3qxha6o/privsep.sock {{(pid=87571) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 07 13:44:11 devstack cinder-volume[87571]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 07 13:44:11 devstack cinder-volume[87571]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 07 13:44:11 devstack cinder-volume[87571]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 07 13:44:11 devstack cinder-volume[87571]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89153 Sep 07 13:44:11 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5800f3c0-a299-49e5-a0d0-e6c431f16733]: (2,) {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:44:11 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3020f590-239a-412f-84e7-13edf3fd229d]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:44:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7085249d-e12c-424a-b253-47bd482ec198 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:11 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7085249d-e12c-424a-b253-47bd482ec198 Sep 07 13:44:11 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:12 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7085249d-e12c-424a-b253-47bd482ec198" returned: 0 in 0.742s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7085249d-e12c-424a-b253-47bd482ec198 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:12 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7085249d-e12c-424a-b253-47bd482ec198 Sep 07 13:44:12 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:12 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7085249d-e12c-424a-b253-47bd482ec198" returned: 0 in 0.374s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] Lock "cinder-quobyte-7085249d-e12c-424a-b253-47bd482ec198" released by "delete_volume" :: held 3.077s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:44:12 devstack cinder-volume[87571]: WARNING cinder.quota [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:44:12 devstack cinder-volume[87571]: WARNING cinder.quota [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:44:12 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] Created reservations ['4f6ceacb-14e1-461a-913b-ac5eac2c8556', '826ea968-5db9-4132-8c9f-99bd8648fa23', 'c60bceb1-d6e4-4c89-9644-b9a0327798a2', '28b99be1-81e3-4a27-b305-f969b87c9702'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:44:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:44:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:44:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:44:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:44:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:44:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:12 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:44:12 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:13 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.380s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:13 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:44:13 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] Deleted volume successfully. Sep 07 13:44:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f596545e-7486-4f8b-88f5-e7d3b8cf6ffe tempest-DeleteServersTestJSON-1870656517 None] Lock "cinder-7085249d-e12c-424a-b253-47bd482ec198-delete_volume" released by "delete_volume" :: held 3.799s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:44:22 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:44:23 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=20,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:44:26 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:44:26 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Flow 'volume_create_manager' (e8712613-bafe-4e72-8730-e3f0dc5cd195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:44:26 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c17b528-0333-4382-80e1-47550d440b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:44:26 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c17b528-0333-4382-80e1-47550d440b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1903254651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea03c3bc-5df2-4e16-9406-7e67afa420ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6ccbc2997c4f56a61320ee9a0d5238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:44:27Z,use_quota=True,user_id='e00fa3cf6b614028a383d7186309efbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:44:26 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bf7468a-d53f-4fba-b0f8-d8b2f66fd096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:44:26 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bf7468a-d53f-4fba-b0f8-d8b2f66fd096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:44:26 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c9e1e6-47a5-41db-8a69-3a42e6a4be60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:44:26 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c9e1e6-47a5-41db-8a69-3a42e6a4be60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea03c3bc-5df2-4e16-9406-7e67afa420ed', 'volume_name': 'volume-ea03c3bc-5df2-4e16-9406-7e67afa420ed', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:44:26 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5814c37-8023-44d1-8077-6d41592bf95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:44:26 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5814c37-8023-44d1-8077-6d41592bf95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:44:26 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68baea01-55a3-4965-84fc-118f58451675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:44:26 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Volume ea03c3bc-5df2-4e16-9406-7e67afa420ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea03c3bc-5df2-4e16-9406-7e67afa420ed', 'volume_size': 1} Sep 07 13:44:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:44:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:44:26 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1903254651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea03c3bc-5df2-4e16-9406-7e67afa420ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6ccbc2997c4f56a61320ee9a0d5238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:44:27Z,use_quota=True,user_id='e00fa3cf6b614028a383d7186309efbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:44:26 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Creating volume ea03c3bc-5df2-4e16-9406-7e67afa420ed {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:44:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:44:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:44:26 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:44:26 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:44:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:44:26 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:44:26 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:44:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ea03c3bc-5df2-4e16-9406-7e67afa420ed 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:26 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ea03c3bc-5df2-4e16-9406-7e67afa420ed 1073741824 Sep 07 13:44:26 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:27 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ea03c3bc-5df2-4e16-9406-7e67afa420ed 1073741824" returned: 0 in 0.534s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ea03c3bc-5df2-4e16-9406-7e67afa420ed {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:27 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ea03c3bc-5df2-4e16-9406-7e67afa420ed Sep 07 13:44:27 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:27 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ea03c3bc-5df2-4e16-9406-7e67afa420ed" returned: 0 in 0.346s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:27 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:44:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:44:27 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68baea01-55a3-4965-84fc-118f58451675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea03c3bc-5df2-4e16-9406-7e67afa420ed', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:44:27 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a764574-8aed-4538-803a-aa93aa495a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:44:27 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Volume volume-ea03c3bc-5df2-4e16-9406-7e67afa420ed (ea03c3bc-5df2-4e16-9406-7e67afa420ed): created successfully Sep 07 13:44:27 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a764574-8aed-4538-803a-aa93aa495a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:44:27 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Flow 'volume_create_manager' (e8712613-bafe-4e72-8730-e3f0dc5cd195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:44:27 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c1f577dc-e88f-489f-9eb1-eddc2e1935b1 tempest-AttachVolumeTestJSON-58750255 None] Created volume successfully. Sep 07 13:44:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:44:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:44:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:44:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:44:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:44:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:44:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:28 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:44:28 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:28 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.349s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:44:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager._thread_info {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:44:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread count: 8 {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:44:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread info: [<_MainThread(MainThread, started 132147689414784)>, , , , , , , ] {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:44:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-894827e2-ecdb-4d7d-916a-3e9f2bead807 req-b4e224fc-903a-4294-9e3a-c158443ea1be tempest-AttachVolumeTestJSON-58750255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:44:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-894827e2-ecdb-4d7d-916a-3e9f2bead807 req-b4e224fc-903a-4294-9e3a-c158443ea1be tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:44:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-894827e2-ecdb-4d7d-916a-3e9f2bead807 req-b4e224fc-903a-4294-9e3a-c158443ea1be tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:44:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-894827e2-ecdb-4d7d-916a-3e9f2bead807 req-b4e224fc-903a-4294-9e3a-c158443ea1be tempest-AttachVolumeTestJSON-58750255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285', 'name': 'volume-ea03c3bc-5df2-4e16-9406-7e67afa420ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ee034cb-e7a5-46de-b584-3d8d1a251a0c', 'enforce_multipath': True} {{(pid=87571) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:44:30 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-894827e2-ecdb-4d7d-916a-3e9f2bead807 req-b4e224fc-903a-4294-9e3a-c158443ea1be tempest-AttachVolumeTestJSON-58750255 None] attachment_update completed successfully. Sep 07 13:44:40 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:UPDATE=4,cinder:SELECT=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:44:40 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:44:59 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=1 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:44:59 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:UPDATE=1 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:45:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-df59d6fe-9fe5-4021-8db5-dbec099c8bba req-b32f812f-d23e-464d-b443-85d5c9708e2e tempest-TaggedAttachmentsTest-1337864321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-df59d6fe-9fe5-4021-8db5-dbec099c8bba req-b32f812f-d23e-464d-b443-85d5c9708e2e tempest-TaggedAttachmentsTest-1337864321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-df59d6fe-9fe5-4021-8db5-dbec099c8bba req-b32f812f-d23e-464d-b443-85d5c9708e2e tempest-TaggedAttachmentsTest-1337864321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-df59d6fe-9fe5-4021-8db5-dbec099c8bba req-b32f812f-d23e-464d-b443-85d5c9708e2e tempest-TaggedAttachmentsTest-1337864321 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285', 'name': 'volume-2069213f-af3f-4a2d-8493-2702138101cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cbbe6140-4bb5-4bb0-bb82-7a81b3748c7d', 'enforce_multipath': True} {{(pid=87571) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:45:10 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-df59d6fe-9fe5-4021-8db5-dbec099c8bba req-b32f812f-d23e-464d-b443-85d5c9708e2e tempest-TaggedAttachmentsTest-1337864321 None] attachment_update completed successfully. Sep 07 13:45:12 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-79c4d09e-1781-4a00-ab32-58abe7284829 req-3fb007b8-3f1d-48dc-a3c9-4efe132d5d83 tempest-AttachVolumeTestJSON-58750255 None] Terminate volume connection completed successfully. Sep 07 13:45:12 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-79c4d09e-1781-4a00-ab32-58abe7284829 req-3fb007b8-3f1d-48dc-a3c9-4efe132d5d83 tempest-AttachVolumeTestJSON-58750255 None] Deleting attachment 2ee034cb-e7a5-46de-b584-3d8d1a251a0c. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:45:15 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-725854ab-16f4-405c-8144-822bcd8cc300 req-0b6f4f87-bca6-4cb7-b894-6c9067d9bf9c tempest-TaggedAttachmentsTest-1337864321 None] Terminate volume connection completed successfully. Sep 07 13:45:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-725854ab-16f4-405c-8144-822bcd8cc300 req-0b6f4f87-bca6-4cb7-b894-6c9067d9bf9c tempest-TaggedAttachmentsTest-1337864321 None] Deleting attachment cbbe6140-4bb5-4bb0-bb82-7a81b3748c7d. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:45:16 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:45:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Flow 'volume_create_manager' (2ece9cd7-9e39-47e4-9ab7-10e2e874570d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:45:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (440633be-1d0d-4297-a942-dd29f9da84a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (440633be-1d0d-4297-a942-dd29f9da84a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1457111326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3881e07f-cc9e-4ea3-b451-865c6ab7c2b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2958148dbb4144e697f4290d8a39123f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:45:16Z,use_quota=True,user_id='da4e8329d71e45b3bc5c9ff362202b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f9e258-504c-45d8-88c6-cfcc9981275c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f9e258-504c-45d8-88c6-cfcc9981275c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6e7e24-21ad-4cd2-9820-3539418342c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6e7e24-21ad-4cd2-9820-3539418342c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3881e07f-cc9e-4ea3-b451-865c6ab7c2b7', 'volume_name': 'volume-3881e07f-cc9e-4ea3-b451-865c6ab7c2b7', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22888fe-2c6a-4913-a6ec-e91b023db6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22888fe-2c6a-4913-a6ec-e91b023db6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1548290-f597-4407-a020-0ce730294ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:16 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Volume 3881e07f-cc9e-4ea3-b451-865c6ab7c2b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3881e07f-cc9e-4ea3-b451-865c6ab7c2b7', 'volume_size': 1} Sep 07 13:45:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1457111326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3881e07f-cc9e-4ea3-b451-865c6ab7c2b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2958148dbb4144e697f4290d8a39123f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:45:16Z,use_quota=True,user_id='da4e8329d71e45b3bc5c9ff362202b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:45:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Creating volume 3881e07f-cc9e-4ea3-b451-865c6ab7c2b7 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:45:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:45:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:45:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:45:16 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:45:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3881e07f-cc9e-4ea3-b451-865c6ab7c2b7 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:16 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3881e07f-cc9e-4ea3-b451-865c6ab7c2b7 1073741824 Sep 07 13:45:16 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:17 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3881e07f-cc9e-4ea3-b451-865c6ab7c2b7 1073741824" returned: 0 in 0.747s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3881e07f-cc9e-4ea3-b451-865c6ab7c2b7 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:17 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3881e07f-cc9e-4ea3-b451-865c6ab7c2b7 Sep 07 13:45:17 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:17 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3881e07f-cc9e-4ea3-b451-865c6ab7c2b7" returned: 0 in 0.293s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:17 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:45:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1548290-f597-4407-a020-0ce730294ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3881e07f-cc9e-4ea3-b451-865c6ab7c2b7', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b66a4d48-c1ae-49f7-be92-fe29ee79d66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:17 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Volume volume-3881e07f-cc9e-4ea3-b451-865c6ab7c2b7 (3881e07f-cc9e-4ea3-b451-865c6ab7c2b7): created successfully Sep 07 13:45:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b66a4d48-c1ae-49f7-be92-fe29ee79d66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Flow 'volume_create_manager' (2ece9cd7-9e39-47e4-9ab7-10e2e874570d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:45:18 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-7acfbde9-5bff-47e7-8599-2feb0146c3c2 tempest-ServersNegativeTestJSON-345178649 None] Created volume successfully. Sep 07 13:45:21 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:45:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Flow 'volume_create_manager' (3922746b-3bfe-4a47-91ab-c9bf6faeefb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:45:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9146d0b4-ce91-4415-a215-e84baadf81d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9146d0b4-ce91-4415-a215-e84baadf81d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1165945527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcbbec54-e3d4-412c-8a11-3cc1d0b959ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2958148dbb4144e697f4290d8a39123f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:45:21Z,use_quota=True,user_id='da4e8329d71e45b3bc5c9ff362202b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9cef44-8854-4948-8ec9-402b25f77b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9cef44-8854-4948-8ec9-402b25f77b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57daa6d4-2ff9-4485-aa6e-b44695e52511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57daa6d4-2ff9-4485-aa6e-b44695e52511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcbbec54-e3d4-412c-8a11-3cc1d0b959ce', 'volume_name': 'volume-dcbbec54-e3d4-412c-8a11-3cc1d0b959ce', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5895f1a7-6e97-4312-935a-a0a9917379f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5895f1a7-6e97-4312-935a-a0a9917379f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b2f8d8-5519-442a-a04b-c714fc58a7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:21 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Volume dcbbec54-e3d4-412c-8a11-3cc1d0b959ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcbbec54-e3d4-412c-8a11-3cc1d0b959ce', 'volume_size': 1} Sep 07 13:45:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1165945527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcbbec54-e3d4-412c-8a11-3cc1d0b959ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2958148dbb4144e697f4290d8a39123f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:45:21Z,use_quota=True,user_id='da4e8329d71e45b3bc5c9ff362202b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:45:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Creating volume dcbbec54-e3d4-412c-8a11-3cc1d0b959ce {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:45:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:45:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:45:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:45:21 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:45:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-dcbbec54-e3d4-412c-8a11-3cc1d0b959ce 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:21 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-dcbbec54-e3d4-412c-8a11-3cc1d0b959ce 1073741824 Sep 07 13:45:21 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:23 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-dcbbec54-e3d4-412c-8a11-3cc1d0b959ce 1073741824" returned: 0 in 1.481s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-dcbbec54-e3d4-412c-8a11-3cc1d0b959ce {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:23 devstack sudo[90840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-dcbbec54-e3d4-412c-8a11-3cc1d0b959ce Sep 07 13:45:23 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:23 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-dcbbec54-e3d4-412c-8a11-3cc1d0b959ce" returned: 0 in 0.662s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] <== create_volume: return (2240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:45:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.243s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b2f8d8-5519-442a-a04b-c714fc58a7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcbbec54-e3d4-412c-8a11-3cc1d0b959ce', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a9987c6-f4bf-4f76-993d-58f93eef5d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:24 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Volume volume-dcbbec54-e3d4-412c-8a11-3cc1d0b959ce (dcbbec54-e3d4-412c-8a11-3cc1d0b959ce): created successfully Sep 07 13:45:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a9987c6-f4bf-4f76-993d-58f93eef5d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Flow 'volume_create_manager' (3922746b-3bfe-4a47-91ab-c9bf6faeefb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:45:24 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-148cd660-6aef-42ee-83b8-6822d4c8a4c9 tempest-ServersNegativeTestJSON-345178649 None] Created volume successfully. Sep 07 13:45:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-76b85496-0d87-4f4a-98f9-7450e8d506a8 tempest-ServersNegativeTestJSON-345178649 None] Acquiring lock "cinder-dcbbec54-e3d4-412c-8a11-3cc1d0b959ce-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:45:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-76b85496-0d87-4f4a-98f9-7450e8d506a8 tempest-ServersNegativeTestJSON-345178649 None] Lock "cinder-dcbbec54-e3d4-412c-8a11-3cc1d0b959ce-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:45:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-76b85496-0d87-4f4a-98f9-7450e8d506a8 tempest-ServersNegativeTestJSON-345178649 None] Acquiring lock "cinder-quobyte-dcbbec54-e3d4-412c-8a11-3cc1d0b959ce" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:45:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-76b85496-0d87-4f4a-98f9-7450e8d506a8 tempest-ServersNegativeTestJSON-345178649 None] Lock "cinder-quobyte-dcbbec54-e3d4-412c-8a11-3cc1d0b959ce" acquired by "delete_volume" :: waited 0.045s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:45:27 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7243855-dd17-49cc-98ed-5e82753126a9]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:45:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-76b85496-0d87-4f4a-98f9-7450e8d506a8 tempest-ServersNegativeTestJSON-345178649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-dcbbec54-e3d4-412c-8a11-3cc1d0b959ce {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:27 devstack sudo[90884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-dcbbec54-e3d4-412c-8a11-3cc1d0b959ce Sep 07 13:45:27 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:27 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-76b85496-0d87-4f4a-98f9-7450e8d506a8 tempest-ServersNegativeTestJSON-345178649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-dcbbec54-e3d4-412c-8a11-3cc1d0b959ce" returned: 0 in 0.745s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-76b85496-0d87-4f4a-98f9-7450e8d506a8 tempest-ServersNegativeTestJSON-345178649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-dcbbec54-e3d4-412c-8a11-3cc1d0b959ce {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:27 devstack sudo[90891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-dcbbec54-e3d4-412c-8a11-3cc1d0b959ce Sep 07 13:45:27 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:28 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-76b85496-0d87-4f4a-98f9-7450e8d506a8 tempest-ServersNegativeTestJSON-345178649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-dcbbec54-e3d4-412c-8a11-3cc1d0b959ce" returned: 0 in 0.296s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-76b85496-0d87-4f4a-98f9-7450e8d506a8 tempest-ServersNegativeTestJSON-345178649 None] Lock "cinder-quobyte-dcbbec54-e3d4-412c-8a11-3cc1d0b959ce" released by "delete_volume" :: held 1.173s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:45:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:45:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:45:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:45:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:28 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-76b85496-0d87-4f4a-98f9-7450e8d506a8 tempest-ServersNegativeTestJSON-345178649 None] Created reservations ['1b299c36-4714-430b-9d53-15dca2f169f8', '9c627ac6-203f-41df-b2b6-3b449813f330', 'ead94d5e-ebfd-4f27-a1be-7b0d529718c5', '4ab38014-620b-4188-b954-8fa5ef37291f'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:45:28 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:45:28 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:28 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.479s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:45:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-76b85496-0d87-4f4a-98f9-7450e8d506a8 tempest-ServersNegativeTestJSON-345178649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-76b85496-0d87-4f4a-98f9-7450e8d506a8 tempest-ServersNegativeTestJSON-345178649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-76b85496-0d87-4f4a-98f9-7450e8d506a8 tempest-ServersNegativeTestJSON-345178649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:45:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-76b85496-0d87-4f4a-98f9-7450e8d506a8 tempest-ServersNegativeTestJSON-345178649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:45:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-76b85496-0d87-4f4a-98f9-7450e8d506a8 tempest-ServersNegativeTestJSON-345178649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-76b85496-0d87-4f4a-98f9-7450e8d506a8 tempest-ServersNegativeTestJSON-345178649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:28 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:45:28 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Flow 'volume_create_manager' (104609f8-1347-40b1-b4c9-bf60fb418572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05bdb7f-9f3b-4c17-8e9b-7df600a199c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05bdb7f-9f3b-4c17-8e9b-7df600a199c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1670755333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84e68d97-91dd-4f03-aab0-72703625dee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18489299488d43958c8db8072ad5a1b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:45:29Z,use_quota=True,user_id='f944c5a66b2c4fe9bfa44db34403bbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:29 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca67b25-e3fa-4e20-be0f-bc768d005a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca67b25-e3fa-4e20-be0f-bc768d005a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b3919c-e556-460b-ad7e-a257c09b4860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b3919c-e556-460b-ad7e-a257c09b4860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84e68d97-91dd-4f03-aab0-72703625dee1', 'volume_name': 'volume-84e68d97-91dd-4f03-aab0-72703625dee1', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe16f121-b0a9-45e0-b9af-d5fcc01cf2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe16f121-b0a9-45e0-b9af-d5fcc01cf2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a197470-9167-407d-8c9f-b7c811115eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:29 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Volume 84e68d97-91dd-4f03-aab0-72703625dee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84e68d97-91dd-4f03-aab0-72703625dee1', 'volume_size': 1} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1670755333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84e68d97-91dd-4f03-aab0-72703625dee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18489299488d43958c8db8072ad5a1b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:45:29Z,use_quota=True,user_id='f944c5a66b2c4fe9bfa44db34403bbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Creating volume 84e68d97-91dd-4f03-aab0-72703625dee1 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:45:29 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84e68d97-91dd-4f03-aab0-72703625dee1 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-76b85496-0d87-4f4a-98f9-7450e8d506a8 tempest-ServersNegativeTestJSON-345178649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.457s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-76b85496-0d87-4f4a-98f9-7450e8d506a8 tempest-ServersNegativeTestJSON-345178649 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:45:29 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-76b85496-0d87-4f4a-98f9-7450e8d506a8 tempest-ServersNegativeTestJSON-345178649 None] Deleted volume successfully. Sep 07 13:45:29 devstack sudo[90900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84e68d97-91dd-4f03-aab0-72703625dee1 1073741824 Sep 07 13:45:29 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-76b85496-0d87-4f4a-98f9-7450e8d506a8 tempest-ServersNegativeTestJSON-345178649 None] Lock "cinder-dcbbec54-e3d4-412c-8a11-3cc1d0b959ce-delete_volume" released by "delete_volume" :: held 2.789s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3bd9e4ad-d3f6-41fd-8622-87bf8002c46f tempest-ServersNegativeTestJSON-345178649 None] Acquiring lock "cinder-3881e07f-cc9e-4ea3-b451-865c6ab7c2b7-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3bd9e4ad-d3f6-41fd-8622-87bf8002c46f tempest-ServersNegativeTestJSON-345178649 None] Lock "cinder-3881e07f-cc9e-4ea3-b451-865c6ab7c2b7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3bd9e4ad-d3f6-41fd-8622-87bf8002c46f tempest-ServersNegativeTestJSON-345178649 None] Acquiring lock "cinder-quobyte-3881e07f-cc9e-4ea3-b451-865c6ab7c2b7" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:45:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3bd9e4ad-d3f6-41fd-8622-87bf8002c46f tempest-ServersNegativeTestJSON-345178649 None] Lock "cinder-quobyte-3881e07f-cc9e-4ea3-b451-865c6ab7c2b7" acquired by "delete_volume" :: waited 0.024s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:45:30 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cf9f10-64ac-430a-8010-9f1d9b215bea]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:45:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3bd9e4ad-d3f6-41fd-8622-87bf8002c46f tempest-ServersNegativeTestJSON-345178649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3881e07f-cc9e-4ea3-b451-865c6ab7c2b7 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:30 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84e68d97-91dd-4f03-aab0-72703625dee1 1073741824" returned: 0 in 0.791s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:30 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3881e07f-cc9e-4ea3-b451-865c6ab7c2b7 Sep 07 13:45:30 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:30 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3bd9e4ad-d3f6-41fd-8622-87bf8002c46f tempest-ServersNegativeTestJSON-345178649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3881e07f-cc9e-4ea3-b451-865c6ab7c2b7" returned: 0 in 0.470s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3bd9e4ad-d3f6-41fd-8622-87bf8002c46f tempest-ServersNegativeTestJSON-345178649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3881e07f-cc9e-4ea3-b451-865c6ab7c2b7 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:30 devstack sudo[90913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3881e07f-cc9e-4ea3-b451-865c6ab7c2b7 Sep 07 13:45:30 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84e68d97-91dd-4f03-aab0-72703625dee1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:30 devstack sudo[90915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84e68d97-91dd-4f03-aab0-72703625dee1 Sep 07 13:45:30 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:30 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3bd9e4ad-d3f6-41fd-8622-87bf8002c46f tempest-ServersNegativeTestJSON-345178649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3881e07f-cc9e-4ea3-b451-865c6ab7c2b7" returned: 0 in 0.327s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3bd9e4ad-d3f6-41fd-8622-87bf8002c46f tempest-ServersNegativeTestJSON-345178649 None] Lock "cinder-quobyte-3881e07f-cc9e-4ea3-b451-865c6ab7c2b7" released by "delete_volume" :: held 0.866s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:45:31 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84e68d97-91dd-4f03-aab0-72703625dee1" returned: 0 in 0.436s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:45:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a197470-9167-407d-8c9f-b7c811115eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84e68d97-91dd-4f03-aab0-72703625dee1', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79bbfa7-1c75-44b2-9097-4a7f3a07eafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:31 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Volume volume-84e68d97-91dd-4f03-aab0-72703625dee1 (84e68d97-91dd-4f03-aab0-72703625dee1): created successfully Sep 07 13:45:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79bbfa7-1c75-44b2-9097-4a7f3a07eafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Flow 'volume_create_manager' (104609f8-1347-40b1-b4c9-bf60fb418572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:45:31 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-3bd9e4ad-d3f6-41fd-8622-87bf8002c46f tempest-ServersNegativeTestJSON-345178649 None] Created reservations ['5bbb1c4a-df97-4095-b83a-5d0380cab6e3', 'b0505ea3-06fd-4604-a1c0-9f7ef2efeaa1', '50014fc3-5a23-4e41-8b03-ad7ec0f6ac36', 'f6af0dec-8392-471b-becd-5e584c5c3411'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:45:31 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-258c1817-1245-428f-9710-db417911948a tempest-VolumesAdminNegativeTest-1967919332 None] Created volume successfully. Sep 07 13:45:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3bd9e4ad-d3f6-41fd-8622-87bf8002c46f tempest-ServersNegativeTestJSON-345178649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3bd9e4ad-d3f6-41fd-8622-87bf8002c46f tempest-ServersNegativeTestJSON-345178649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3bd9e4ad-d3f6-41fd-8622-87bf8002c46f tempest-ServersNegativeTestJSON-345178649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:45:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3bd9e4ad-d3f6-41fd-8622-87bf8002c46f tempest-ServersNegativeTestJSON-345178649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:45:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3bd9e4ad-d3f6-41fd-8622-87bf8002c46f tempest-ServersNegativeTestJSON-345178649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3bd9e4ad-d3f6-41fd-8622-87bf8002c46f tempest-ServersNegativeTestJSON-345178649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:31 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:45:31 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:31 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3bd9e4ad-d3f6-41fd-8622-87bf8002c46f tempest-ServersNegativeTestJSON-345178649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.294s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:31 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-3bd9e4ad-d3f6-41fd-8622-87bf8002c46f tempest-ServersNegativeTestJSON-345178649 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:45:31 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-3bd9e4ad-d3f6-41fd-8622-87bf8002c46f tempest-ServersNegativeTestJSON-345178649 None] Deleted volume successfully. Sep 07 13:45:31 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3bd9e4ad-d3f6-41fd-8622-87bf8002c46f tempest-ServersNegativeTestJSON-345178649 None] Lock "cinder-3881e07f-cc9e-4ea3-b451-865c6ab7c2b7-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:45:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fd74dbc1-cf31-44c3-8224-de2734ffd6da tempest-VolumesAdminNegativeTest-1967919332 None] Acquiring lock "cinder-84e68d97-91dd-4f03-aab0-72703625dee1-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:45:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fd74dbc1-cf31-44c3-8224-de2734ffd6da tempest-VolumesAdminNegativeTest-1967919332 None] Lock "cinder-84e68d97-91dd-4f03-aab0-72703625dee1-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:45:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fd74dbc1-cf31-44c3-8224-de2734ffd6da tempest-VolumesAdminNegativeTest-1967919332 None] Acquiring lock "cinder-quobyte-84e68d97-91dd-4f03-aab0-72703625dee1" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:45:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fd74dbc1-cf31-44c3-8224-de2734ffd6da tempest-VolumesAdminNegativeTest-1967919332 None] Lock "cinder-quobyte-84e68d97-91dd-4f03-aab0-72703625dee1" acquired by "delete_volume" :: waited 0.053s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:45:32 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd0cfdf-bd8d-431c-8fcf-f260b8bd3788]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:45:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fd74dbc1-cf31-44c3-8224-de2734ffd6da tempest-VolumesAdminNegativeTest-1967919332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84e68d97-91dd-4f03-aab0-72703625dee1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:32 devstack sudo[90925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84e68d97-91dd-4f03-aab0-72703625dee1 Sep 07 13:45:32 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:33 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fd74dbc1-cf31-44c3-8224-de2734ffd6da tempest-VolumesAdminNegativeTest-1967919332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84e68d97-91dd-4f03-aab0-72703625dee1" returned: 0 in 0.766s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fd74dbc1-cf31-44c3-8224-de2734ffd6da tempest-VolumesAdminNegativeTest-1967919332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84e68d97-91dd-4f03-aab0-72703625dee1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:33 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84e68d97-91dd-4f03-aab0-72703625dee1 Sep 07 13:45:33 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:34 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fd74dbc1-cf31-44c3-8224-de2734ffd6da tempest-VolumesAdminNegativeTest-1967919332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84e68d97-91dd-4f03-aab0-72703625dee1" returned: 0 in 0.783s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fd74dbc1-cf31-44c3-8224-de2734ffd6da tempest-VolumesAdminNegativeTest-1967919332 None] Lock "cinder-quobyte-84e68d97-91dd-4f03-aab0-72703625dee1" released by "delete_volume" :: held 1.660s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:45:34 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-fd74dbc1-cf31-44c3-8224-de2734ffd6da tempest-VolumesAdminNegativeTest-1967919332 None] Created reservations ['81708662-6cf8-4798-88ea-a05fcba7612f', 'cdbe085e-d234-4f9c-bb3b-dae068c52a14', '4cbb2a5e-068a-48af-9563-075fd4624f88', 'd4333434-4728-4889-a42c-e36d46e9eebd'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:45:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fd74dbc1-cf31-44c3-8224-de2734ffd6da tempest-VolumesAdminNegativeTest-1967919332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fd74dbc1-cf31-44c3-8224-de2734ffd6da tempest-VolumesAdminNegativeTest-1967919332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fd74dbc1-cf31-44c3-8224-de2734ffd6da tempest-VolumesAdminNegativeTest-1967919332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:45:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fd74dbc1-cf31-44c3-8224-de2734ffd6da tempest-VolumesAdminNegativeTest-1967919332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:45:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fd74dbc1-cf31-44c3-8224-de2734ffd6da tempest-VolumesAdminNegativeTest-1967919332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fd74dbc1-cf31-44c3-8224-de2734ffd6da tempest-VolumesAdminNegativeTest-1967919332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:34 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:45:34 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:35 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fd74dbc1-cf31-44c3-8224-de2734ffd6da tempest-VolumesAdminNegativeTest-1967919332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.859s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:35 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-fd74dbc1-cf31-44c3-8224-de2734ffd6da tempest-VolumesAdminNegativeTest-1967919332 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:45:35 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-fd74dbc1-cf31-44c3-8224-de2734ffd6da tempest-VolumesAdminNegativeTest-1967919332 None] Deleted volume successfully. Sep 07 13:45:35 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fd74dbc1-cf31-44c3-8224-de2734ffd6da tempest-VolumesAdminNegativeTest-1967919332 None] Lock "cinder-84e68d97-91dd-4f03-aab0-72703625dee1-delete_volume" released by "delete_volume" :: held 3.037s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:45:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e112b0c2-5831-40c6-b3f1-5684f9416328 tempest-TaggedAttachmentsTest-1337864321 None] Acquiring lock "cinder-2069213f-af3f-4a2d-8493-2702138101cf-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:45:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e112b0c2-5831-40c6-b3f1-5684f9416328 tempest-TaggedAttachmentsTest-1337864321 None] Lock "cinder-2069213f-af3f-4a2d-8493-2702138101cf-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:45:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e112b0c2-5831-40c6-b3f1-5684f9416328 tempest-TaggedAttachmentsTest-1337864321 None] Acquiring lock "cinder-quobyte-2069213f-af3f-4a2d-8493-2702138101cf" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:45:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e112b0c2-5831-40c6-b3f1-5684f9416328 tempest-TaggedAttachmentsTest-1337864321 None] Lock "cinder-quobyte-2069213f-af3f-4a2d-8493-2702138101cf" acquired by "delete_volume" :: waited 0.014s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:45:38 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebc546e-6764-4f21-82a1-4ede9d1e7793]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:45:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e112b0c2-5831-40c6-b3f1-5684f9416328 tempest-TaggedAttachmentsTest-1337864321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2069213f-af3f-4a2d-8493-2702138101cf {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:38 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2069213f-af3f-4a2d-8493-2702138101cf Sep 07 13:45:38 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:39 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e112b0c2-5831-40c6-b3f1-5684f9416328 tempest-TaggedAttachmentsTest-1337864321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2069213f-af3f-4a2d-8493-2702138101cf" returned: 0 in 0.393s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e112b0c2-5831-40c6-b3f1-5684f9416328 tempest-TaggedAttachmentsTest-1337864321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2069213f-af3f-4a2d-8493-2702138101cf {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:39 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2069213f-af3f-4a2d-8493-2702138101cf Sep 07 13:45:39 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:39 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e112b0c2-5831-40c6-b3f1-5684f9416328 tempest-TaggedAttachmentsTest-1337864321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2069213f-af3f-4a2d-8493-2702138101cf" returned: 0 in 0.261s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e112b0c2-5831-40c6-b3f1-5684f9416328 tempest-TaggedAttachmentsTest-1337864321 None] Lock "cinder-quobyte-2069213f-af3f-4a2d-8493-2702138101cf" released by "delete_volume" :: held 0.702s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:45:39 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-e112b0c2-5831-40c6-b3f1-5684f9416328 tempest-TaggedAttachmentsTest-1337864321 None] Created reservations ['355a98ee-b164-408b-bf5d-7e3af2f0b63b', '8be44a12-a456-41ad-a43a-788cb6a5fc2e', '2075e520-7ab0-4a05-97b2-3015a009715f', '797e215d-9969-46fe-96e9-2693e7116805'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:45:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e112b0c2-5831-40c6-b3f1-5684f9416328 tempest-TaggedAttachmentsTest-1337864321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e112b0c2-5831-40c6-b3f1-5684f9416328 tempest-TaggedAttachmentsTest-1337864321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e112b0c2-5831-40c6-b3f1-5684f9416328 tempest-TaggedAttachmentsTest-1337864321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:45:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e112b0c2-5831-40c6-b3f1-5684f9416328 tempest-TaggedAttachmentsTest-1337864321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:45:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e112b0c2-5831-40c6-b3f1-5684f9416328 tempest-TaggedAttachmentsTest-1337864321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e112b0c2-5831-40c6-b3f1-5684f9416328 tempest-TaggedAttachmentsTest-1337864321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:39 devstack sudo[91004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:45:39 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:39 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e112b0c2-5831-40c6-b3f1-5684f9416328 tempest-TaggedAttachmentsTest-1337864321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.272s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:39 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-e112b0c2-5831-40c6-b3f1-5684f9416328 tempest-TaggedAttachmentsTest-1337864321 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:45:39 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-e112b0c2-5831-40c6-b3f1-5684f9416328 tempest-TaggedAttachmentsTest-1337864321 None] Deleted volume successfully. Sep 07 13:45:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e112b0c2-5831-40c6-b3f1-5684f9416328 tempest-TaggedAttachmentsTest-1337864321 None] Lock "cinder-2069213f-af3f-4a2d-8493-2702138101cf-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:45:49 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-147a2ae8-9278-4abc-91f2-749ab34c343e tempest-GroupSnapshotsTest-1017917195 None] Group tempest-GroupSnapshotsTest-Group-1470893327: creating Sep 07 13:45:49 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-147a2ae8-9278-4abc-91f2-749ab34c343e tempest-GroupSnapshotsTest-1017917195 None] Group tempest-GroupSnapshotsTest-Group-1470893327: created successfully Sep 07 13:45:49 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-147a2ae8-9278-4abc-91f2-749ab34c343e tempest-GroupSnapshotsTest-1017917195 None] Create group completed successfully. Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Flow 'volume_create_manager' (befa1dd4-0cd0-4d74-9db6-3b61621b3c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6cd9958-a3bd-4f49-b96b-4064750624fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6cd9958-a3bd-4f49-b96b-4064750624fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-668827723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7406eb9e-6430-4acf-8610-d608a7247aa6,host='devstack@QuobyteHD#QuobyteHD',id=390b3390-5b6c-4c24-a157-d5bda94ad6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d4bf01e89d40ad80929cecd5ffcc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:45:51Z,use_quota=True,user_id='fa633fee4a674a55bf09333a6ac6f9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(762b9f20-4312-4ca9-8925-09f7d5f084d9),volume_type_id=762b9f20-4312-4ca9-8925-09f7d5f084d9)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c3259f-61a7-4969-a295-bebb523279b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c3259f-61a7-4969-a295-bebb523279b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fdf8c7b-04df-4ef2-9f53-0ff0ca53414f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fdf8c7b-04df-4ef2-9f53-0ff0ca53414f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '390b3390-5b6c-4c24-a157-d5bda94ad6a5', 'volume_name': 'volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d109288f-1000-4e78-b411-7057171b8a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d109288f-1000-4e78-b411-7057171b8a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278b978e-e323-454b-bdb2-e51854580777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:51 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Volume 390b3390-5b6c-4c24-a157-d5bda94ad6a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5', 'volume_size': 1} Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7406eb9e-6430-4acf-8610-d608a7247aa6,created_at=2026-09-07T11:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-668827723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7406eb9e-6430-4acf-8610-d608a7247aa6,host='devstack@QuobyteHD#QuobyteHD',id=390b3390-5b6c-4c24-a157-d5bda94ad6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d4bf01e89d40ad80929cecd5ffcc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:45:51Z,use_quota=True,user_id='fa633fee4a674a55bf09333a6ac6f9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(762b9f20-4312-4ca9-8925-09f7d5f084d9),volume_type_id=762b9f20-4312-4ca9-8925-09f7d5f084d9)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Creating volume 390b3390-5b6c-4c24-a157-d5bda94ad6a5 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:45:51 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:51 devstack sudo[91057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5 1073741824 Sep 07 13:45:51 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:51 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5 1073741824" returned: 0 in 0.476s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:51 devstack sudo[91063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5 Sep 07 13:45:51 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:52 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5" returned: 0 in 0.262s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:52 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:45:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:52 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278b978e-e323-454b-bdb2-e51854580777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:52 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f0adaf-96f9-4b4d-88b1-a8c0ff00da31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:52 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Volume volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5 (390b3390-5b6c-4c24-a157-d5bda94ad6a5): created successfully Sep 07 13:45:52 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f0adaf-96f9-4b4d-88b1-a8c0ff00da31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:52 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Flow 'volume_create_manager' (befa1dd4-0cd0-4d74-9db6-3b61621b3c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:45:52 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-ba827ca7-56a4-4172-8690-53eb42c9914d tempest-GroupSnapshotsTest-1017917195 None] Created volume successfully. Sep 07 13:45:52 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-8a30f6cc-7c69-4448-a53f-a6e324f47d8a tempest-GroupSnapshotsTest-1017917195 None] GroupSnapshot 351699ad-b01b-4cb2-aa65-7ae4678359df: creating. Sep 07 13:45:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8a30f6cc-7c69-4448-a53f-a6e324f47d8a tempest-GroupSnapshotsTest-1017917195 None] Group snapshot 351699ad-b01b-4cb2-aa65-7ae4678359df: creating. {{(pid=87571) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 13:45:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8a30f6cc-7c69-4448-a53f-a6e324f47d8a tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8a30f6cc-7c69-4448-a53f-a6e324f47d8a tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-8a30f6cc-7c69-4448-a53f-a6e324f47d8a tempest-GroupSnapshotsTest-1017917195 None] Creating offline snapshot 55741f40-aa66-44c9-be1e-3595f63e4e4d of volume 390b3390-5b6c-4c24-a157-d5bda94ad6a5 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:45:53 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d6c86b-c56d-4b07-8402-0a46bc843baa]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:45:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a30f6cc-7c69-4448-a53f-a6e324f47d8a tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:53 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5 Sep 07 13:45:53 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:53 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a30f6cc-7c69-4448-a53f-a6e324f47d8a tempest-GroupSnapshotsTest-1017917195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5" returned: 0 in 0.389s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a30f6cc-7c69-4448-a53f-a6e324f47d8a tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.55741f40-aa66-44c9-be1e-3595f63e4e4d 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:53 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.55741f40-aa66-44c9-be1e-3595f63e4e4d 1G Sep 07 13:45:53 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:53 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a30f6cc-7c69-4448-a53f-a6e324f47d8a tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.55741f40-aa66-44c9-be1e-3595f63e4e4d 1G" returned: 0 in 0.550s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a30f6cc-7c69-4448-a53f-a6e324f47d8a tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.55741f40-aa66-44c9-be1e-3595f63e4e4d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:54 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.55741f40-aa66-44c9-be1e-3595f63e4e4d Sep 07 13:45:54 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:54 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a30f6cc-7c69-4448-a53f-a6e324f47d8a tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.55741f40-aa66-44c9-be1e-3595f63e4e4d" returned: 0 in 0.369s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:54 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-8a30f6cc-7c69-4448-a53f-a6e324f47d8a tempest-GroupSnapshotsTest-1017917195 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.55741f40-aa66-44c9-be1e-3595f63e4e4d is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:45:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a30f6cc-7c69-4448-a53f-a6e324f47d8a tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.55741f40-aa66-44c9-be1e-3595f63e4e4d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:54 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.55741f40-aa66-44c9-be1e-3595f63e4e4d Sep 07 13:45:54 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:54 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a30f6cc-7c69-4448-a53f-a6e324f47d8a tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.55741f40-aa66-44c9-be1e-3595f63e4e4d" returned: 0 in 0.368s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a30f6cc-7c69-4448-a53f-a6e324f47d8a tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:54 devstack sudo[91088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.info Sep 07 13:45:54 devstack sudo[91088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:55 devstack sudo[91088]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a30f6cc-7c69-4448-a53f-a6e324f47d8a tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.info" returned: 0 in 0.328s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:55 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-8a30f6cc-7c69-4448-a53f-a6e324f47d8a tempest-GroupSnapshotsTest-1017917195 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:45:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a30f6cc-7c69-4448-a53f-a6e324f47d8a tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:55 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.info Sep 07 13:45:55 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:55 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a30f6cc-7c69-4448-a53f-a6e324f47d8a tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.info" returned: 0 in 0.295s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8a30f6cc-7c69-4448-a53f-a6e324f47d8a tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.393s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:55 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-8a30f6cc-7c69-4448-a53f-a6e324f47d8a tempest-GroupSnapshotsTest-1017917195 None] group_snapshot 351699ad-b01b-4cb2-aa65-7ae4678359df: created successfully Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "cinder-quobyte-55741f40-aa66-44c9-be1e-3595f63e4e4d-4908d2e8-3d94-4f36-bd70-fce002aa12f1" by "_create_volume_from_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-55741f40-aa66-44c9-be1e-3595f63e4e4d-4908d2e8-3d94-4f36-bd70-fce002aa12f1" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Creating volume 4908d2e8-3d94-4f36-bd70-fce002aa12f1 from snapshot 55741f40-aa66-44c9-be1e-3595f63e4e4d {{(pid=87571) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "cinder-quobyte-4908d2e8-3d94-4f36-bd70-fce002aa12f1" by "_copy_volume_from_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-4908d2e8-3d94-4f36-bd70-fce002aa12f1" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] snapshot: 55741f40-aa66-44c9-be1e-3595f63e4e4d, volume: 4908d2e8-3d94-4f36-bd70-fce002aa12f1, {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[be99ae71-0824-48ee-a6af-c4bbd58791ba]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.55741f40-aa66-44c9-be1e-3595f63e4e4d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:57 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.55741f40-aa66-44c9-be1e-3595f63e4e4d Sep 07 13:45:57 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:57 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.55741f40-aa66-44c9-be1e-3595f63e4e4d" returned: 0 in 0.498s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[881f0b7e-1d1a-4aaa-bfcf-bee652ff213c]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:45:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:57 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5 Sep 07 13:45:57 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:58 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5" returned: 0 in 0.448s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5 {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 13:45:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Creating direct copy from snapshot {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 13:45:58 devstack cinder-volume[87571]: DEBUG cinder.utils [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Path /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4908d2e8-3d94-4f36-bd70-fce002aa12f1 not found in is_blk_device check {{(pid=87571) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 13:45:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4908d2e8-3d94-4f36-bd70-fce002aa12f1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:58 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4908d2e8-3d94-4f36-bd70-fce002aa12f1 Sep 07 13:45:58 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4908d2e8-3d94-4f36-bd70-fce002aa12f1" returned: 0 in 6.311s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:04 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5, size 1024.00 MB, duration 6.31 sec, destination /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4908d2e8-3d94-4f36-bd70-fce002aa12f1 {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:46:04 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Converted 1024.00 MB image at 162.23 MB/s Sep 07 13:46:04 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4908d2e8-3d94-4f36-bd70-fce002aa12f1 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:46:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4908d2e8-3d94-4f36-bd70-fce002aa12f1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:04 devstack sudo[91195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4908d2e8-3d94-4f36-bd70-fce002aa12f1 Sep 07 13:46:04 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:04 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4908d2e8-3d94-4f36-bd70-fce002aa12f1" returned: 0 in 0.302s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-4908d2e8-3d94-4f36-bd70-fce002aa12f1" released by "_copy_volume_from_snapshot" :: held 7.699s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:46:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-55741f40-aa66-44c9-be1e-3595f63e4e4d-4908d2e8-3d94-4f36-bd70-fce002aa12f1" released by "_create_volume_from_snapshot" :: held 7.786s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:46:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.801s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:05 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-5c57ac8b-a406-4473-9901-8199ed2e42dc tempest-GroupSnapshotsTest-1017917195 None] Create group from source-snapshot-351699ad-b01b-4cb2-aa65-7ae4678359df completed successfully. Sep 07 13:46:06 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1ae5eed0-06dc-4012-b0d3-b244e318cdc0 tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "cinder-quobyte-4908d2e8-3d94-4f36-bd70-fce002aa12f1" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:46:06 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1ae5eed0-06dc-4012-b0d3-b244e318cdc0 tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-4908d2e8-3d94-4f36-bd70-fce002aa12f1" acquired by "delete_volume" :: waited 0.030s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:46:06 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c570dc-9f93-44a2-974e-52c1bb5f9d64]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1ae5eed0-06dc-4012-b0d3-b244e318cdc0 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4908d2e8-3d94-4f36-bd70-fce002aa12f1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:06 devstack sudo[91200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4908d2e8-3d94-4f36-bd70-fce002aa12f1 Sep 07 13:46:06 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:07 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1ae5eed0-06dc-4012-b0d3-b244e318cdc0 tempest-GroupSnapshotsTest-1017917195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4908d2e8-3d94-4f36-bd70-fce002aa12f1" returned: 0 in 0.629s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1ae5eed0-06dc-4012-b0d3-b244e318cdc0 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4908d2e8-3d94-4f36-bd70-fce002aa12f1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:07 devstack sudo[91221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4908d2e8-3d94-4f36-bd70-fce002aa12f1 Sep 07 13:46:07 devstack sudo[91221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:07 devstack sudo[91221]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1ae5eed0-06dc-4012-b0d3-b244e318cdc0 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4908d2e8-3d94-4f36-bd70-fce002aa12f1" returned: 0 in 0.411s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:07 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1ae5eed0-06dc-4012-b0d3-b244e318cdc0 tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-4908d2e8-3d94-4f36-bd70-fce002aa12f1" released by "delete_volume" :: held 1.137s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:46:07 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-1ae5eed0-06dc-4012-b0d3-b244e318cdc0 tempest-GroupSnapshotsTest-1017917195 None] Created reservations ['55082f87-747a-44b7-9553-6b30ae58af6a'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:46:07 devstack cinder-volume[87571]: WARNING cinder.quota [None req-1ae5eed0-06dc-4012-b0d3-b244e318cdc0 tempest-GroupSnapshotsTest-1017917195 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-999817262 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-999817262, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:46:07 devstack cinder-volume[87571]: WARNING cinder.quota [None req-1ae5eed0-06dc-4012-b0d3-b244e318cdc0 tempest-GroupSnapshotsTest-1017917195 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-999817262 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-999817262, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:46:07 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-1ae5eed0-06dc-4012-b0d3-b244e318cdc0 tempest-GroupSnapshotsTest-1017917195 None] Created reservations ['e8aa372a-deaa-423b-8681-e2dce9ed0a7f', 'cd756dc2-4989-45bc-87b1-ffc794d02e2a', '965305c5-19b5-4bb8-9b97-726b73673283', '0a9cb7b3-a0e0-4dd3-93c1-4cfe8f532628'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:46:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1ae5eed0-06dc-4012-b0d3-b244e318cdc0 tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1ae5eed0-06dc-4012-b0d3-b244e318cdc0 tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:08 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1ae5eed0-06dc-4012-b0d3-b244e318cdc0 tempest-GroupSnapshotsTest-1017917195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:46:08 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1ae5eed0-06dc-4012-b0d3-b244e318cdc0 tempest-GroupSnapshotsTest-1017917195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:46:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1ae5eed0-06dc-4012-b0d3-b244e318cdc0 tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1ae5eed0-06dc-4012-b0d3-b244e318cdc0 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:08 devstack sudo[91271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:46:08 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:08 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1ae5eed0-06dc-4012-b0d3-b244e318cdc0 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.459s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:08 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-1ae5eed0-06dc-4012-b0d3-b244e318cdc0 tempest-GroupSnapshotsTest-1017917195 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:46:08 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-1ae5eed0-06dc-4012-b0d3-b244e318cdc0 tempest-GroupSnapshotsTest-1017917195 None] Delete group completed successfully. Sep 07 13:46:09 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-bfe35f69-09ec-4bba-abac-02692a8628df tempest-GroupSnapshotsTest-1017917195 None] group_snapshot 351699ad-b01b-4cb2-aa65-7ae4678359df: deleting Sep 07 13:46:09 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=52,cinder:UPDATE=67,cinder:INSERT=16,cinder:DELETE=5 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:46:09 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=65,cinder:UPDATE=57,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:46:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-bfe35f69-09ec-4bba-abac-02692a8628df tempest-GroupSnapshotsTest-1017917195 None] group_snapshot 351699ad-b01b-4cb2-aa65-7ae4678359df: deleting {{(pid=87571) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 13:46:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-bfe35f69-09ec-4bba-abac-02692a8628df tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "cinder-quobyte-390b3390-5b6c-4c24-a157-d5bda94ad6a5" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:46:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-bfe35f69-09ec-4bba-abac-02692a8628df tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-390b3390-5b6c-4c24-a157-d5bda94ad6a5" acquired by "delete_snapshot" :: waited 0.069s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:46:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-bfe35f69-09ec-4bba-abac-02692a8628df tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "cinder-quobyte-55741f40-aa66-44c9-be1e-3595f63e4e4d" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:46:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-bfe35f69-09ec-4bba-abac-02692a8628df tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-55741f40-aa66-44c9-be1e-3595f63e4e4d" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:46:09 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-bfe35f69-09ec-4bba-abac-02692a8628df tempest-GroupSnapshotsTest-1017917195 None] Deleting offline snapshot 55741f40-aa66-44c9-be1e-3595f63e4e4d of volume 390b3390-5b6c-4c24-a157-d5bda94ad6a5 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:46:09 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-bfe35f69-09ec-4bba-abac-02692a8628df tempest-GroupSnapshotsTest-1017917195 None] snapshot_file for this snap is: volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.55741f40-aa66-44c9-be1e-3595f63e4e4d {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:46:09 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a522bbd3-f4d6-495f-abc9-91bc247f5377]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bfe35f69-09ec-4bba-abac-02692a8628df tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.55741f40-aa66-44c9-be1e-3595f63e4e4d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:09 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.55741f40-aa66-44c9-be1e-3595f63e4e4d Sep 07 13:46:09 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:10 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bfe35f69-09ec-4bba-abac-02692a8628df tempest-GroupSnapshotsTest-1017917195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.55741f40-aa66-44c9-be1e-3595f63e4e4d" returned: 0 in 0.520s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-bfe35f69-09ec-4bba-abac-02692a8628df tempest-GroupSnapshotsTest-1017917195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:46:10 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[af65ab11-2dc9-41a4-b364-e7462f079c72]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bfe35f69-09ec-4bba-abac-02692a8628df tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:10 devstack sudo[91287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5 Sep 07 13:46:10 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:11 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bfe35f69-09ec-4bba-abac-02692a8628df tempest-GroupSnapshotsTest-1017917195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5" returned: 0 in 0.707s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bfe35f69-09ec-4bba-abac-02692a8628df tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.55741f40-aa66-44c9-be1e-3595f63e4e4d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:11 devstack sudo[91293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.55741f40-aa66-44c9-be1e-3595f63e4e4d Sep 07 13:46:11 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:11 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bfe35f69-09ec-4bba-abac-02692a8628df tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.55741f40-aa66-44c9-be1e-3595f63e4e4d" returned: 0 in 0.495s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bfe35f69-09ec-4bba-abac-02692a8628df tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.55741f40-aa66-44c9-be1e-3595f63e4e4d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:11 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.55741f40-aa66-44c9-be1e-3595f63e4e4d Sep 07 13:46:11 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:12 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bfe35f69-09ec-4bba-abac-02692a8628df tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5.55741f40-aa66-44c9-be1e-3595f63e4e4d" returned: 0 in 0.533s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-bfe35f69-09ec-4bba-abac-02692a8628df tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-55741f40-aa66-44c9-be1e-3595f63e4e4d" released by "_delete_snapshot" :: held 2.417s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:46:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-bfe35f69-09ec-4bba-abac-02692a8628df tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-390b3390-5b6c-4c24-a157-d5bda94ad6a5" released by "delete_snapshot" :: held 2.495s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:46:12 devstack cinder-volume[87571]: WARNING cinder.quota [None req-bfe35f69-09ec-4bba-abac-02692a8628df tempest-GroupSnapshotsTest-1017917195 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-999817262 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-999817262, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:46:12 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-bfe35f69-09ec-4bba-abac-02692a8628df tempest-GroupSnapshotsTest-1017917195 None] Created reservations ['c80d1670-b113-4cd8-8a1b-a6bf7bb445bf', 'c59137b8-0431-49f2-bdbd-25d61b3b69de', '3f9cafca-302c-458d-87d1-318ee20e3f52', 'db34368f-85a6-4ae0-8dd2-e8a5d9922fac'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:46:12 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-bfe35f69-09ec-4bba-abac-02692a8628df tempest-GroupSnapshotsTest-1017917195 None] group_snapshot 351699ad-b01b-4cb2-aa65-7ae4678359df: deleted successfully Sep 07 13:46:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b647ee27-9d37-49f7-abad-6945862fa9d8 tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "cinder-quobyte-390b3390-5b6c-4c24-a157-d5bda94ad6a5" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:46:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b647ee27-9d37-49f7-abad-6945862fa9d8 tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-390b3390-5b6c-4c24-a157-d5bda94ad6a5" acquired by "delete_volume" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:46:13 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd4f25d-1848-4f37-8b2e-99651e8e8ae2]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b647ee27-9d37-49f7-abad-6945862fa9d8 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:13 devstack sudo[91304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5 Sep 07 13:46:13 devstack sudo[91304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:14 devstack sudo[91304]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b647ee27-9d37-49f7-abad-6945862fa9d8 tempest-GroupSnapshotsTest-1017917195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5" returned: 0 in 0.544s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b647ee27-9d37-49f7-abad-6945862fa9d8 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:14 devstack sudo[91310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5 Sep 07 13:46:14 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:14 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b647ee27-9d37-49f7-abad-6945862fa9d8 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-390b3390-5b6c-4c24-a157-d5bda94ad6a5" returned: 0 in 0.524s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:14 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b647ee27-9d37-49f7-abad-6945862fa9d8 tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-390b3390-5b6c-4c24-a157-d5bda94ad6a5" released by "delete_volume" :: held 1.160s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:46:15 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-b647ee27-9d37-49f7-abad-6945862fa9d8 tempest-GroupSnapshotsTest-1017917195 None] Created reservations ['102c727f-f3cc-4211-a878-364069b4374c'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:46:15 devstack cinder-volume[87571]: WARNING cinder.db.api [None req-b647ee27-9d37-49f7-abad-6945862fa9d8 tempest-GroupSnapshotsTest-1017917195 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-999817262'] Sep 07 13:46:15 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-b647ee27-9d37-49f7-abad-6945862fa9d8 tempest-GroupSnapshotsTest-1017917195 None] Created reservations ['e96d23b2-75b4-41ce-b88f-31b24795500e', '60a6fdcf-1217-425d-88d1-2bfc83c83601', '5952e90e-d7bc-4d67-a5e6-c4e15a959f2c', '621c3611-3d88-4d94-8885-81ca90d0aec5'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:46:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b647ee27-9d37-49f7-abad-6945862fa9d8 tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b647ee27-9d37-49f7-abad-6945862fa9d8 tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b647ee27-9d37-49f7-abad-6945862fa9d8 tempest-GroupSnapshotsTest-1017917195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:46:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b647ee27-9d37-49f7-abad-6945862fa9d8 tempest-GroupSnapshotsTest-1017917195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:46:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b647ee27-9d37-49f7-abad-6945862fa9d8 tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b647ee27-9d37-49f7-abad-6945862fa9d8 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:15 devstack sudo[91313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:46:15 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:15 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b647ee27-9d37-49f7-abad-6945862fa9d8 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.626s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:16 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-b647ee27-9d37-49f7-abad-6945862fa9d8 tempest-GroupSnapshotsTest-1017917195 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:46:16 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-b647ee27-9d37-49f7-abad-6945862fa9d8 tempest-GroupSnapshotsTest-1017917195 None] Delete group completed successfully. Sep 07 13:46:16 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-2b2f864b-9fc4-422b-b631-12f4fb9d98d6 tempest-GroupSnapshotsTest-1017917195 None] Group tempest-GroupSnapshotsTest-Group-2126195967: creating Sep 07 13:46:16 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-2b2f864b-9fc4-422b-b631-12f4fb9d98d6 tempest-GroupSnapshotsTest-1017917195 None] Group tempest-GroupSnapshotsTest-Group-2126195967: created successfully Sep 07 13:46:16 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-2b2f864b-9fc4-422b-b631-12f4fb9d98d6 tempest-GroupSnapshotsTest-1017917195 None] Create group completed successfully. Sep 07 13:46:18 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:46:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Flow 'volume_create_manager' (76cd0c0d-1de9-4102-b800-265b37da5738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4cd281-9cf0-40b3-89d4-705f4337aa6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4cd281-9cf0-40b3-89d4-705f4337aa6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-108932985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=81f84f05-4cff-4da7-9f6c-2b80898fef30,host='devstack@QuobyteHD#QuobyteHD',id=618f445d-cad6-47be-89b0-779bf1df4c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d4bf01e89d40ad80929cecd5ffcc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:19Z,use_quota=True,user_id='fa633fee4a674a55bf09333a6ac6f9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6d4d415-9a46-4506-939a-9b30703f990b),volume_type_id=a6d4d415-9a46-4506-939a-9b30703f990b)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c39609f-c916-427c-916d-616117bbd6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c39609f-c916-427c-916d-616117bbd6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f5e092-af47-4dfe-b326-b97c5f74b91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f5e092-af47-4dfe-b326-b97c5f74b91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '618f445d-cad6-47be-89b0-779bf1df4c02', 'volume_name': 'volume-618f445d-cad6-47be-89b0-779bf1df4c02', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73240b2-8af5-4ca0-a411-387cfee374d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73240b2-8af5-4ca0-a411-387cfee374d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32dae556-8f0c-44e0-b0bc-5802199213a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:18 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Volume 618f445d-cad6-47be-89b0-779bf1df4c02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-618f445d-cad6-47be-89b0-779bf1df4c02', 'volume_size': 1} Sep 07 13:46:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=81f84f05-4cff-4da7-9f6c-2b80898fef30,created_at=2026-09-07T11:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-108932985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=81f84f05-4cff-4da7-9f6c-2b80898fef30,host='devstack@QuobyteHD#QuobyteHD',id=618f445d-cad6-47be-89b0-779bf1df4c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d4bf01e89d40ad80929cecd5ffcc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:19Z,use_quota=True,user_id='fa633fee4a674a55bf09333a6ac6f9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6d4d415-9a46-4506-939a-9b30703f990b),volume_type_id=a6d4d415-9a46-4506-939a-9b30703f990b)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:46:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Creating volume 618f445d-cad6-47be-89b0-779bf1df4c02 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:46:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:46:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:46:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:46:18 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:46:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:18 devstack sudo[91321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02 1073741824 Sep 07 13:46:18 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:19 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02 1073741824" returned: 0 in 0.664s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:19 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02 Sep 07 13:46:19 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:19 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02" returned: 0 in 0.441s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:19 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:46:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:19 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32dae556-8f0c-44e0-b0bc-5802199213a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-618f445d-cad6-47be-89b0-779bf1df4c02', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:19 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7207211a-9986-4662-8bf2-00aee30ed90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:20 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Volume volume-618f445d-cad6-47be-89b0-779bf1df4c02 (618f445d-cad6-47be-89b0-779bf1df4c02): created successfully Sep 07 13:46:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7207211a-9986-4662-8bf2-00aee30ed90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Flow 'volume_create_manager' (76cd0c0d-1de9-4102-b800-265b37da5738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:20 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-9231d395-024f-46f6-9b0a-96077220fbce tempest-GroupSnapshotsTest-1017917195 None] Created volume successfully. Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Flow 'volume_create_manager' (eb75e5a3-d4d3-43a6-9aac-d0ecd0dae6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5db3ba-b510-46d2-9f3a-1459425dbc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5db3ba-b510-46d2-9f3a-1459425dbc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1693731630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=81f84f05-4cff-4da7-9f6c-2b80898fef30,host='devstack@QuobyteHD#QuobyteHD',id=3ef74405-781c-48a6-bbd1-522d88d32b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d4bf01e89d40ad80929cecd5ffcc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:22Z,use_quota=True,user_id='fa633fee4a674a55bf09333a6ac6f9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6d4d415-9a46-4506-939a-9b30703f990b),volume_type_id=a6d4d415-9a46-4506-939a-9b30703f990b)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c9058cb-2acf-4ee4-874a-c1047f49c2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c9058cb-2acf-4ee4-874a-c1047f49c2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465b2320-1753-41ef-8dc5-8603134b5327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465b2320-1753-41ef-8dc5-8603134b5327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ef74405-781c-48a6-bbd1-522d88d32b62', 'volume_name': 'volume-3ef74405-781c-48a6-bbd1-522d88d32b62', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7e97b7-9ed4-4fce-b5df-604cfba7fc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7e97b7-9ed4-4fce-b5df-604cfba7fc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc77e6b-66d1-479b-909f-7f7b4dea45e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:22 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Volume 3ef74405-781c-48a6-bbd1-522d88d32b62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ef74405-781c-48a6-bbd1-522d88d32b62', 'volume_size': 1} Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=81f84f05-4cff-4da7-9f6c-2b80898fef30,created_at=2026-09-07T11:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1693731630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=81f84f05-4cff-4da7-9f6c-2b80898fef30,host='devstack@QuobyteHD#QuobyteHD',id=3ef74405-781c-48a6-bbd1-522d88d32b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d4bf01e89d40ad80929cecd5ffcc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:22Z,use_quota=True,user_id='fa633fee4a674a55bf09333a6ac6f9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6d4d415-9a46-4506-939a-9b30703f990b),volume_type_id=a6d4d415-9a46-4506-939a-9b30703f990b)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Creating volume 3ef74405-781c-48a6-bbd1-522d88d32b62 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:46:22 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:22 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62 1073741824 Sep 07 13:46:22 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:22 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62 1073741824" returned: 0 in 0.592s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:22 devstack sudo[91359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62 Sep 07 13:46:22 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:23 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62" returned: 0 in 0.269s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:46:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc77e6b-66d1-479b-909f-7f7b4dea45e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ef74405-781c-48a6-bbd1-522d88d32b62', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e89022c2-787b-4627-a836-c569c0020703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:23 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Volume volume-3ef74405-781c-48a6-bbd1-522d88d32b62 (3ef74405-781c-48a6-bbd1-522d88d32b62): created successfully Sep 07 13:46:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e89022c2-787b-4627-a836-c569c0020703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Flow 'volume_create_manager' (eb75e5a3-d4d3-43a6-9aac-d0ecd0dae6cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:23 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c1858000-0bd7-4bd7-be22-b79598af929c tempest-GroupSnapshotsTest-1017917195 None] Created volume successfully. Sep 07 13:46:23 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-6ea06ca6-df2a-4846-a489-7f8d347d9848 tempest-GroupSnapshotsTest-1017917195 None] Update group completed successfully. Sep 07 13:46:24 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-56529ca7-3cf1-4665-a085-fd1a339ab249 tempest-GroupSnapshotsTest-1017917195 None] Update group completed successfully. Sep 07 13:46:26 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-bc42b504-d27b-4eb5-a3ed-7a62d57e18c0 tempest-GroupSnapshotsTest-1017917195 None] Update group completed successfully. Sep 07 13:46:27 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-47156a0e-cd59-452a-94be-052a46d797e8 tempest-GroupSnapshotsTest-1017917195 None] Update group completed successfully. Sep 07 13:46:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:46:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:46:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:46:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:28 devstack sudo[91383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:46:28 devstack sudo[91383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:28 devstack sudo[91383]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.432s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:46:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager._thread_info {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:46:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread count: 8 {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:46:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread info: [<_MainThread(MainThread, started 132147689414784)>, , , , , , , ] {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:46:29 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] GroupSnapshot e60edd53-7ac5-4d90-a194-d1dabd49c037: creating. Sep 07 13:46:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] Group snapshot e60edd53-7ac5-4d90-a194-d1dabd49c037: creating. {{(pid=87571) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 13:46:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] Creating offline snapshot 0f419fea-4939-433d-b52c-2e1baf92db17 of volume 3ef74405-781c-48a6-bbd1-522d88d32b62 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:46:29 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4e5307-7fe1-419c-99e9-1a5d5c0b1046]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:30 devstack sudo[91443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62 Sep 07 13:46:30 devstack sudo[91443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:30 devstack sudo[91443]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62" returned: 0 in 0.732s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.0f419fea-4939-433d-b52c-2e1baf92db17 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:30 devstack sudo[91461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.0f419fea-4939-433d-b52c-2e1baf92db17 1G Sep 07 13:46:30 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:31 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.0f419fea-4939-433d-b52c-2e1baf92db17 1G" returned: 0 in 0.547s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ef74405-781c-48a6-bbd1-522d88d32b62 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.0f419fea-4939-433d-b52c-2e1baf92db17 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:31 devstack sudo[91470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ef74405-781c-48a6-bbd1-522d88d32b62 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.0f419fea-4939-433d-b52c-2e1baf92db17 Sep 07 13:46:31 devstack sudo[91470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:31 devstack sudo[91470]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ef74405-781c-48a6-bbd1-522d88d32b62 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.0f419fea-4939-433d-b52c-2e1baf92db17" returned: 0 in 0.630s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:31 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.0f419fea-4939-433d-b52c-2e1baf92db17 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:46:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.0f419fea-4939-433d-b52c-2e1baf92db17 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:31 devstack sudo[91480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.0f419fea-4939-433d-b52c-2e1baf92db17 Sep 07 13:46:31 devstack sudo[91480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:32 devstack sudo[91480]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.0f419fea-4939-433d-b52c-2e1baf92db17" returned: 0 in 0.448s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:32 devstack sudo[91484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.info Sep 07 13:46:32 devstack sudo[91484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:32 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:46:32 devstack sudo[91484]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Flow 'volume_create_manager' (c822a8fc-01b3-4d57-be06-bb104cc44a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89059e0d-11be-4cb9-bcc9-d42997194fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.info" returned: 0 in 0.496s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:32 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:46:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:32 devstack sudo[91489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.info Sep 07 13:46:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89059e0d-11be-4cb9-bcc9-d42997194fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1528889773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce192be7-0607-4fbf-9403-1cd4f91d4da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6ccbc2997c4f56a61320ee9a0d5238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:33Z,use_quota=True,user_id='e00fa3cf6b614028a383d7186309efbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:32 devstack sudo[91489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1071b85d-58a3-4666-a022-5d86841c8837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1071b85d-58a3-4666-a022-5d86841c8837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb2781a-d576-46ca-8ba7-045a5775293b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb2781a-d576-46ca-8ba7-045a5775293b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce192be7-0607-4fbf-9403-1cd4f91d4da2', 'volume_name': 'volume-ce192be7-0607-4fbf-9403-1cd4f91d4da2', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b939d97-93df-47d2-aa11-f0eb0648f707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b939d97-93df-47d2-aa11-f0eb0648f707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9b0131-6ff9-4df5-8150-874fb10887d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:32 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Volume ce192be7-0607-4fbf-9403-1cd4f91d4da2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce192be7-0607-4fbf-9403-1cd4f91d4da2', 'volume_size': 1} Sep 07 13:46:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:33 devstack sudo[91489]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.info" returned: 0 in 0.548s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.585s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] Creating offline snapshot 732f82f2-ee2f-46b1-b20a-5c9c8fa4b769 of volume 618f445d-cad6-47be-89b0-779bf1df4c02 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:46:33 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[40de674e-f7b5-4dba-82e4-86b198dc8867]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:33 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02 Sep 07 13:46:33 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:34 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02" returned: 0 in 0.671s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.732f82f2-ee2f-46b1-b20a-5c9c8fa4b769 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:34 devstack sudo[91501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.732f82f2-ee2f-46b1-b20a-5c9c8fa4b769 1G Sep 07 13:46:34 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:35 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.732f82f2-ee2f-46b1-b20a-5c9c8fa4b769 1G" returned: 0 in 0.889s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-618f445d-cad6-47be-89b0-779bf1df4c02 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.732f82f2-ee2f-46b1-b20a-5c9c8fa4b769 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:35 devstack sudo[91523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-618f445d-cad6-47be-89b0-779bf1df4c02 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.732f82f2-ee2f-46b1-b20a-5c9c8fa4b769 Sep 07 13:46:35 devstack sudo[91523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:35 devstack sudo[91523]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-618f445d-cad6-47be-89b0-779bf1df4c02 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.732f82f2-ee2f-46b1-b20a-5c9c8fa4b769" returned: 0 in 0.629s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:35 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.732f82f2-ee2f-46b1-b20a-5c9c8fa4b769 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:46:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.732f82f2-ee2f-46b1-b20a-5c9c8fa4b769 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:35 devstack sudo[91536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.732f82f2-ee2f-46b1-b20a-5c9c8fa4b769 Sep 07 13:46:35 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:36 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.732f82f2-ee2f-46b1-b20a-5c9c8fa4b769" returned: 0 in 0.366s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:36 devstack sudo[91539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.info Sep 07 13:46:36 devstack sudo[91539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:36 devstack sudo[91539]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.info" returned: 0 in 0.542s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:36 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:46:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:36 devstack sudo[91550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.info Sep 07 13:46:36 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:37 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.info" returned: 0 in 0.534s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.845s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.269s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:37 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1528889773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce192be7-0607-4fbf-9403-1cd4f91d4da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6ccbc2997c4f56a61320ee9a0d5238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:33Z,use_quota=True,user_id='e00fa3cf6b614028a383d7186309efbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:46:37 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Creating volume ce192be7-0607-4fbf-9403-1cd4f91d4da2 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:46:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:37 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:46:37 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:46:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:37 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:46:37 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:46:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce192be7-0607-4fbf-9403-1cd4f91d4da2 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:37 devstack sudo[91569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce192be7-0607-4fbf-9403-1cd4f91d4da2 1073741824 Sep 07 13:46:37 devstack sudo[91569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:37 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-98a0f4d6-7655-404c-9572-7b461dc80dd7 tempest-GroupSnapshotsTest-1017917195 None] group_snapshot e60edd53-7ac5-4d90-a194-d1dabd49c037: created successfully Sep 07 13:46:38 devstack sudo[91569]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce192be7-0607-4fbf-9403-1cd4f91d4da2 1073741824" returned: 0 in 0.865s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce192be7-0607-4fbf-9403-1cd4f91d4da2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:38 devstack sudo[91577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce192be7-0607-4fbf-9403-1cd4f91d4da2 Sep 07 13:46:38 devstack sudo[91577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:38 devstack sudo[91577]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce192be7-0607-4fbf-9403-1cd4f91d4da2" returned: 0 in 0.428s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:46:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9b0131-6ff9-4df5-8150-874fb10887d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce192be7-0607-4fbf-9403-1cd4f91d4da2', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1ab249-b960-4b03-8da1-eebd44fd418c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:38 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Volume volume-ce192be7-0607-4fbf-9403-1cd4f91d4da2 (ce192be7-0607-4fbf-9403-1cd4f91d4da2): created successfully Sep 07 13:46:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1ab249-b960-4b03-8da1-eebd44fd418c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Flow 'volume_create_manager' (c822a8fc-01b3-4d57-be06-bb104cc44a7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:38 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-a51235d6-f6a8-4040-9f61-cf4ce3188001 tempest-AttachVolumeTestJSON-58750255 None] Created volume successfully. Sep 07 13:46:38 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] group_snapshot e60edd53-7ac5-4d90-a194-d1dabd49c037: deleting Sep 07 13:46:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] group_snapshot e60edd53-7ac5-4d90-a194-d1dabd49c037: deleting {{(pid=87571) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 13:46:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "cinder-quobyte-3ef74405-781c-48a6-bbd1-522d88d32b62" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:46:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-3ef74405-781c-48a6-bbd1-522d88d32b62" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:46:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "cinder-quobyte-0f419fea-4939-433d-b52c-2e1baf92db17" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:46:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-0f419fea-4939-433d-b52c-2e1baf92db17" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:46:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Deleting offline snapshot 0f419fea-4939-433d-b52c-2e1baf92db17 of volume 3ef74405-781c-48a6-bbd1-522d88d32b62 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:46:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] snapshot_file for this snap is: volume-3ef74405-781c-48a6-bbd1-522d88d32b62.0f419fea-4939-433d-b52c-2e1baf92db17 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:46:39 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3325d70c-1988-45b6-80dc-b939987e5b56]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.0f419fea-4939-433d-b52c-2e1baf92db17 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:39 devstack sudo[91580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.0f419fea-4939-433d-b52c-2e1baf92db17 Sep 07 13:46:39 devstack sudo[91580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:40 devstack sudo[91580]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.0f419fea-4939-433d-b52c-2e1baf92db17" returned: 0 in 1.091s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:40 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ef74405-781c-48a6-bbd1-522d88d32b62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:46:40 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6644a9-ad58-4d2a-b091-dc28415e3964]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:40 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62 Sep 07 13:46:40 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:41 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62" returned: 0 in 1.044s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.0f419fea-4939-433d-b52c-2e1baf92db17 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:41 devstack sudo[91657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.0f419fea-4939-433d-b52c-2e1baf92db17 Sep 07 13:46:41 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-fdffabd3-94aa-422f-9094-769e5b4d7bb3 req-dea7aa89-ae0b-4cf7-83f6-da54c5b9af14 tempest-AttachVolumeTestJSON-58750255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-fdffabd3-94aa-422f-9094-769e5b4d7bb3 req-dea7aa89-ae0b-4cf7-83f6-da54c5b9af14 tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-fdffabd3-94aa-422f-9094-769e5b4d7bb3 req-dea7aa89-ae0b-4cf7-83f6-da54c5b9af14 tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-fdffabd3-94aa-422f-9094-769e5b4d7bb3 req-dea7aa89-ae0b-4cf7-83f6-da54c5b9af14 tempest-AttachVolumeTestJSON-58750255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285', 'name': 'volume-ce192be7-0607-4fbf-9403-1cd4f91d4da2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c2a90da-5728-45cf-b6ef-a9b711794e18', 'enforce_multipath': True} {{(pid=87571) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:46:42 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-fdffabd3-94aa-422f-9094-769e5b4d7bb3 req-dea7aa89-ae0b-4cf7-83f6-da54c5b9af14 tempest-AttachVolumeTestJSON-58750255 None] attachment_update completed successfully. Sep 07 13:46:42 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.0f419fea-4939-433d-b52c-2e1baf92db17" returned: 0 in 1.302s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.0f419fea-4939-433d-b52c-2e1baf92db17 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:42 devstack sudo[91697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.0f419fea-4939-433d-b52c-2e1baf92db17 Sep 07 13:46:42 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:43 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62.0f419fea-4939-433d-b52c-2e1baf92db17" returned: 0 in 0.916s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-0f419fea-4939-433d-b52c-2e1baf92db17" released by "_delete_snapshot" :: held 4.807s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:46:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-3ef74405-781c-48a6-bbd1-522d88d32b62" released by "delete_snapshot" :: held 4.855s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:46:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "cinder-quobyte-618f445d-cad6-47be-89b0-779bf1df4c02" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:46:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-618f445d-cad6-47be-89b0-779bf1df4c02" acquired by "delete_snapshot" :: waited 0.062s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:46:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "cinder-quobyte-732f82f2-ee2f-46b1-b20a-5c9c8fa4b769" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:46:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-732f82f2-ee2f-46b1-b20a-5c9c8fa4b769" acquired by "_delete_snapshot" :: waited 0.070s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:46:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Deleting offline snapshot 732f82f2-ee2f-46b1-b20a-5c9c8fa4b769 of volume 618f445d-cad6-47be-89b0-779bf1df4c02 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:46:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] snapshot_file for this snap is: volume-618f445d-cad6-47be-89b0-779bf1df4c02.732f82f2-ee2f-46b1-b20a-5c9c8fa4b769 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:46:44 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10d3855-80d2-4e08-a062-42af10902bed]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.732f82f2-ee2f-46b1-b20a-5c9c8fa4b769 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:44 devstack sudo[92106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.732f82f2-ee2f-46b1-b20a-5c9c8fa4b769 Sep 07 13:46:44 devstack sudo[92106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:45 devstack sudo[92106]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.732f82f2-ee2f-46b1-b20a-5c9c8fa4b769" returned: 0 in 1.096s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:45 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-618f445d-cad6-47be-89b0-779bf1df4c02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:46:45 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c91b5e6-0396-4ec7-bcf3-805737bc384c]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:45 devstack sudo[92141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02 Sep 07 13:46:45 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:46 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02" returned: 0 in 0.828s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.732f82f2-ee2f-46b1-b20a-5c9c8fa4b769 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:46 devstack sudo[92149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.732f82f2-ee2f-46b1-b20a-5c9c8fa4b769 Sep 07 13:46:46 devstack sudo[92149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Flow 'volume_create_manager' (e8920bcf-b189-4622-8ce8-1edfadf76acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b16cfa8-1ffb-44ee-b0fd-6ca9aa4184b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b16cfa8-1ffb-44ee-b0fd-6ca9aa4184b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-61410320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6cb910-a117-47d1-980f-873e87b6d7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6ccbc2997c4f56a61320ee9a0d5238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:46Z,use_quota=True,user_id='e00fa3cf6b614028a383d7186309efbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ef0091-b796-4842-a112-ab8dfed9c649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ef0091-b796-4842-a112-ab8dfed9c649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f527df-0d29-46d3-a313-767fb5664460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f527df-0d29-46d3-a313-767fb5664460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d6cb910-a117-47d1-980f-873e87b6d7f0', 'volume_name': 'volume-0d6cb910-a117-47d1-980f-873e87b6d7f0', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8bfb7b3-fbd8-4cd9-a86d-3179c5767205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8bfb7b3-fbd8-4cd9-a86d-3179c5767205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56427fe6-7a53-4666-87ca-20fa552e4fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:46 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Volume 0d6cb910-a117-47d1-980f-873e87b6d7f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d6cb910-a117-47d1-980f-873e87b6d7f0', 'volume_size': 1} Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-61410320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6cb910-a117-47d1-980f-873e87b6d7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6ccbc2997c4f56a61320ee9a0d5238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:46Z,use_quota=True,user_id='e00fa3cf6b614028a383d7186309efbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Creating volume 0d6cb910-a117-47d1-980f-873e87b6d7f0 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:46:46 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d6cb910-a117-47d1-980f-873e87b6d7f0 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:46 devstack sudo[92149]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.732f82f2-ee2f-46b1-b20a-5c9c8fa4b769" returned: 0 in 0.558s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.732f82f2-ee2f-46b1-b20a-5c9c8fa4b769 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:46 devstack sudo[92155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.732f82f2-ee2f-46b1-b20a-5c9c8fa4b769 Sep 07 13:46:46 devstack sudo[92155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:46 devstack sudo[92154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d6cb910-a117-47d1-980f-873e87b6d7f0 1073741824 Sep 07 13:46:46 devstack sudo[92154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:47 devstack sudo[92155]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02.732f82f2-ee2f-46b1-b20a-5c9c8fa4b769" returned: 0 in 0.430s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-732f82f2-ee2f-46b1-b20a-5c9c8fa4b769" released by "_delete_snapshot" :: held 3.171s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:46:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-618f445d-cad6-47be-89b0-779bf1df4c02" released by "delete_snapshot" :: held 3.259s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:46:47 devstack cinder-volume[87571]: WARNING cinder.quota [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1728825335 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1728825335, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:46:47 devstack cinder-volume[87571]: WARNING cinder.quota [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1728825335 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1728825335, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:46:47 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Created reservations ['6356e3b1-9192-4ba8-964c-eb34e8934440', '3ab1d7ba-b40c-4f8e-9a89-2ca5eb7453d7', '10c0d11b-85fe-4c29-b1bd-429124e934f2', '6ccd35ef-bb84-492e-bd43-ee22e31abef4'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:46:47 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] Created reservations ['abcfc510-c361-4c25-898b-1aac6c1ddca6', '43b03331-ff64-4bc3-a2cc-0d01ef95acb3', '381e3ee7-5abb-43e3-aed4-d10526f02208', 'b79a5ce6-1af6-4749-a545-30805caa4578'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:46:47 devstack sudo[92154]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d6cb910-a117-47d1-980f-873e87b6d7f0 1073741824" returned: 0 in 1.106s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d6cb910-a117-47d1-980f-873e87b6d7f0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:47 devstack sudo[92174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d6cb910-a117-47d1-980f-873e87b6d7f0 Sep 07 13:46:47 devstack sudo[92174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:47 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-3796f378-7e37-4d48-bc5c-4289323f46c0 tempest-GroupSnapshotsTest-1017917195 None] group_snapshot e60edd53-7ac5-4d90-a194-d1dabd49c037: deleted successfully Sep 07 13:46:48 devstack sudo[92174]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d6cb910-a117-47d1-980f-873e87b6d7f0" returned: 0 in 0.406s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:46:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56427fe6-7a53-4666-87ca-20fa552e4fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d6cb910-a117-47d1-980f-873e87b6d7f0', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336d9313-5a8f-4c18-a9d7-1b82c040421d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:48 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Volume volume-0d6cb910-a117-47d1-980f-873e87b6d7f0 (0d6cb910-a117-47d1-980f-873e87b6d7f0): created successfully Sep 07 13:46:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336d9313-5a8f-4c18-a9d7-1b82c040421d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Flow 'volume_create_manager' (e8920bcf-b189-4622-8ce8-1edfadf76acb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:48 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-e0b32c2a-a7c6-4b59-bf80-2075d136b36c tempest-AttachVolumeTestJSON-58750255 None] Created volume successfully. Sep 07 13:46:49 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "cinder-quobyte-3ef74405-781c-48a6-bbd1-522d88d32b62" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:46:49 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-3ef74405-781c-48a6-bbd1-522d88d32b62" acquired by "delete_volume" :: waited 0.044s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:46:49 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3e02b3-a0c9-4f3b-9f58-59ddfb14f5a1]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:49 devstack sudo[92209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62 Sep 07 13:46:49 devstack sudo[92209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:50 devstack sudo[92209]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62" returned: 0 in 0.634s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:50 devstack sudo[92230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62 Sep 07 13:46:50 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-2a23cf31-92e6-4bb0-bb98-e3f13b4e1f1b req-e6a7e155-3dec-49ef-a047-021f360f3282 tempest-AttachVolumeTestJSON-58750255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-2a23cf31-92e6-4bb0-bb98-e3f13b4e1f1b req-e6a7e155-3dec-49ef-a047-021f360f3282 tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-2a23cf31-92e6-4bb0-bb98-e3f13b4e1f1b req-e6a7e155-3dec-49ef-a047-021f360f3282 tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-2a23cf31-92e6-4bb0-bb98-e3f13b4e1f1b req-e6a7e155-3dec-49ef-a047-021f360f3282 tempest-AttachVolumeTestJSON-58750255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285', 'name': 'volume-0d6cb910-a117-47d1-980f-873e87b6d7f0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68d09ed7-c9d1-45e8-9457-190602ecc777', 'enforce_multipath': True} {{(pid=87571) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:46:50 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-2a23cf31-92e6-4bb0-bb98-e3f13b4e1f1b req-e6a7e155-3dec-49ef-a047-021f360f3282 tempest-AttachVolumeTestJSON-58750255 None] attachment_update completed successfully. Sep 07 13:46:50 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3ef74405-781c-48a6-bbd1-522d88d32b62" returned: 0 in 0.469s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:50 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-3ef74405-781c-48a6-bbd1-522d88d32b62" released by "delete_volume" :: held 1.200s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:46:50 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "cinder-quobyte-618f445d-cad6-47be-89b0-779bf1df4c02" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:46:50 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-618f445d-cad6-47be-89b0-779bf1df4c02" acquired by "delete_volume" :: waited 0.027s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:46:50 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[243e5e35-c6b1-4309-83e7-5a90b09c2b04]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:50 devstack sudo[92256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02 Sep 07 13:46:50 devstack sudo[92256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:51 devstack sudo[92256]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02" returned: 0 in 0.669s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:51 devstack sudo[92261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02 Sep 07 13:46:51 devstack sudo[92261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:51 devstack sudo[92261]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-618f445d-cad6-47be-89b0-779bf1df4c02" returned: 0 in 0.420s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-618f445d-cad6-47be-89b0-779bf1df4c02" released by "delete_volume" :: held 1.198s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:46:51 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] Created reservations ['caa1889d-4ccd-49de-ab7a-b24403528dee'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:46:52 devstack cinder-volume[87571]: WARNING cinder.quota [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1728825335 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1728825335, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:46:52 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] Created reservations ['764a0848-ab5d-4520-a794-af2eb8b73f0a', 'a33f6e76-b94b-4b0c-969d-cbfc646e585d', '16675eb2-b340-48b5-8664-0cfebe70c2c3', '7f032092-db0f-4d5a-8070-020180a780e4'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:46:52 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] Created reservations ['b9aa7cb6-9abd-404b-b45f-d069d9c5d353', '98dce2a0-f75b-4d04-98d6-a6ddcbe0ebcf', 'bc3ee8cf-5cc2-4d0b-8bdb-59fa79c6c2f8', 'acb6a853-028b-417b-a147-4599343149ae'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:46:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:52 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:46:52 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:46:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:52 devstack sudo[92267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:46:52 devstack sudo[92267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:53 devstack sudo[92267]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.441s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:53 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:46:53 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-08dafcfe-92f3-489b-82e0-b732883a6361 tempest-GroupSnapshotsTest-1017917195 None] Delete group completed successfully. Sep 07 13:46:54 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-06569947-a59c-4d8a-a693-c705bda19f75 tempest-GroupSnapshotsTest-1017917195 None] Group tempest-GroupSnapshotsTest-Group-1132307065: creating Sep 07 13:46:54 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-06569947-a59c-4d8a-a693-c705bda19f75 tempest-GroupSnapshotsTest-1017917195 None] Group tempest-GroupSnapshotsTest-Group-1132307065: created successfully Sep 07 13:46:54 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-06569947-a59c-4d8a-a693-c705bda19f75 tempest-GroupSnapshotsTest-1017917195 None] Create group completed successfully. Sep 07 13:46:54 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-05640583-8c2e-4d71-aad6-5165230651ee req-8d034d93-71c6-4472-9b8c-3e21908088b0 tempest-AttachVolumeTestJSON-58750255 None] Terminate volume connection completed successfully. Sep 07 13:46:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-05640583-8c2e-4d71-aad6-5165230651ee req-8d034d93-71c6-4472-9b8c-3e21908088b0 tempest-AttachVolumeTestJSON-58750255 None] Deleting attachment 7c2a90da-5728-45cf-b6ef-a9b711794e18. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:46:55 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:46:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Flow 'volume_create_manager' (87d8ab2c-1f5b-4444-a4c8-2856f72ad721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315023e2-400a-48a1-b3be-e7b5f67e177e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315023e2-400a-48a1-b3be-e7b5f67e177e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-477231555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d447148-ab86-4007-bc49-ecd70d4e898e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab47bf37ff924a6399657f3751bf94e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:55Z,use_quota=True,user_id='bcc59b17a561402492658016dabebb39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d103328-28ba-45f6-8d28-3b4e087f058b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d103328-28ba-45f6-8d28-3b4e087f058b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3347ccb5-4b0d-4876-b8d0-44e54251f923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3347ccb5-4b0d-4876-b8d0-44e54251f923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d447148-ab86-4007-bc49-ecd70d4e898e', 'volume_name': 'volume-8d447148-ab86-4007-bc49-ecd70d4e898e', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119350e8-4a74-4993-849a-e30621ad47dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119350e8-4a74-4993-849a-e30621ad47dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4090ce6a-5685-40c3-9713-e735e1e89fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:55 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Volume 8d447148-ab86-4007-bc49-ecd70d4e898e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d447148-ab86-4007-bc49-ecd70d4e898e', 'volume_size': 1} Sep 07 13:46:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-477231555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d447148-ab86-4007-bc49-ecd70d4e898e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab47bf37ff924a6399657f3751bf94e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:55Z,use_quota=True,user_id='bcc59b17a561402492658016dabebb39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:46:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Creating volume 8d447148-ab86-4007-bc49-ecd70d4e898e {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:46:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:46:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:46:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:46:55 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:46:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8d447148-ab86-4007-bc49-ecd70d4e898e 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:55 devstack sudo[92273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8d447148-ab86-4007-bc49-ecd70d4e898e 1073741824 Sep 07 13:46:55 devstack sudo[92273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:56 devstack sudo[92273]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:56 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:46:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Flow 'volume_create_manager' (56d865c2-6a5e-474d-8890-9d88e844a1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08481645-eba2-49fa-acb5-5e8a23180911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8d447148-ab86-4007-bc49-ecd70d4e898e 1073741824" returned: 0 in 1.043s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08481645-eba2-49fa-acb5-5e8a23180911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-395516781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=317d4ba4-9c1a-4916-83f5-f2fa953dc885,host='devstack@QuobyteHD#QuobyteHD',id=41162dac-9509-49fd-9fbd-21a4b6067c58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d4bf01e89d40ad80929cecd5ffcc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:56Z,use_quota=True,user_id='fa633fee4a674a55bf09333a6ac6f9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52c8a648-a7a5-4ed5-9f90-68528b608959),volume_type_id=52c8a648-a7a5-4ed5-9f90-68528b608959)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e584cb-e6b3-40c1-87ca-2c754bbe49f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e584cb-e6b3-40c1-87ca-2c754bbe49f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2649f403-b605-4cb9-9dfa-3e2ba54e9832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2649f403-b605-4cb9-9dfa-3e2ba54e9832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41162dac-9509-49fd-9fbd-21a4b6067c58', 'volume_name': 'volume-41162dac-9509-49fd-9fbd-21a4b6067c58', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba734a4-b2ab-4ba6-ad82-5c4cd95b28a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba734a4-b2ab-4ba6-ad82-5c4cd95b28a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f9aa9b7-eeac-4cc1-9d9e-c28ee33fb140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:56 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Volume 41162dac-9509-49fd-9fbd-21a4b6067c58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41162dac-9509-49fd-9fbd-21a4b6067c58', 'volume_size': 1} Sep 07 13:46:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:56 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-307d4d08-e207-47b5-9c51-717f8f6e7090 req-096cd3a9-83e2-4f4c-883a-5147fddcb707 tempest-AttachVolumeTestJSON-58750255 None] Terminate volume connection completed successfully. Sep 07 13:46:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-307d4d08-e207-47b5-9c51-717f8f6e7090 req-096cd3a9-83e2-4f4c-883a-5147fddcb707 tempest-AttachVolumeTestJSON-58750255 None] Deleting attachment 68d09ed7-c9d1-45e8-9457-190602ecc777. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:46:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8d447148-ab86-4007-bc49-ecd70d4e898e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:56 devstack sudo[92309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8d447148-ab86-4007-bc49-ecd70d4e898e Sep 07 13:46:56 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:57 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8d447148-ab86-4007-bc49-ecd70d4e898e" returned: 0 in 0.405s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.468s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=317d4ba4-9c1a-4916-83f5-f2fa953dc885,created_at=2026-09-07T11:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-395516781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=317d4ba4-9c1a-4916-83f5-f2fa953dc885,host='devstack@QuobyteHD#QuobyteHD',id=41162dac-9509-49fd-9fbd-21a4b6067c58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d4bf01e89d40ad80929cecd5ffcc4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:56Z,use_quota=True,user_id='fa633fee4a674a55bf09333a6ac6f9c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52c8a648-a7a5-4ed5-9f90-68528b608959),volume_type_id=52c8a648-a7a5-4ed5-9f90-68528b608959)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Creating volume 41162dac-9509-49fd-9fbd-21a4b6067c58 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:46:57 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:57 devstack sudo[92313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58 1073741824 Sep 07 13:46:57 devstack sudo[92313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4090ce6a-5685-40c3-9713-e735e1e89fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d447148-ab86-4007-bc49-ecd70d4e898e', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43562e14-2738-46b6-a8cf-ea210c94f964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:57 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Volume volume-8d447148-ab86-4007-bc49-ecd70d4e898e (8d447148-ab86-4007-bc49-ecd70d4e898e): created successfully Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43562e14-2738-46b6-a8cf-ea210c94f964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Flow 'volume_create_manager' (87d8ab2c-1f5b-4444-a4c8-2856f72ad721) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:57 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-b4a8df4b-3261-4b80-bb9a-6d1aff5d9df4 tempest-ServerRescueNegativeTestJSON-2101076822 None] Created volume successfully. Sep 07 13:46:57 devstack sudo[92313]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58 1073741824" returned: 0 in 0.752s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Flow 'volume_create_manager' (8b0ca750-67d5-43ae-bf8d-f0c1f72cb5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e9f892-b877-4f2e-9b27-3a2f575f0fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e9f892-b877-4f2e-9b27-3a2f575f0fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1817269648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d3cfbae-a7e0-4743-b4e5-334d8abd71d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050bb3bb5a2e4059a7bb924e2bcbf8a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:58Z,use_quota=True,user_id='7dc270088b894d91aa05542bc3edb4af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bdedef2-e46a-43bc-9b4a-d5b70bce897f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bdedef2-e46a-43bc-9b4a-d5b70bce897f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c227e4-24ab-4aff-8e5a-ef0f7108e3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c227e4-24ab-4aff-8e5a-ef0f7108e3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d3cfbae-a7e0-4743-b4e5-334d8abd71d2', 'volume_name': 'volume-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4ad9d2-893c-4025-8ca8-0ac474a2891b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4ad9d2-893c-4025-8ca8-0ac474a2891b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c11ad87f-85ec-4ddd-934a-464acc65ddb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:58 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Volume 9d3cfbae-a7e0-4743-b4e5-334d8abd71d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2', 'volume_size': 1} Sep 07 13:46:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:58 devstack sudo[92320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58 Sep 07 13:46:58 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:58 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58" returned: 0 in 0.403s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:46:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.420s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1817269648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d3cfbae-a7e0-4743-b4e5-334d8abd71d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050bb3bb5a2e4059a7bb924e2bcbf8a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:58Z,use_quota=True,user_id='7dc270088b894d91aa05542bc3edb4af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:46:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Creating volume 9d3cfbae-a7e0-4743-b4e5-334d8abd71d2 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:46:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:46:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:46:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:46:58 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:46:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f9aa9b7-eeac-4cc1-9d9e-c28ee33fb140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41162dac-9509-49fd-9fbd-21a4b6067c58', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:58 devstack sudo[92325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2 1073741824 Sep 07 13:46:58 devstack sudo[92325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19b7f443-5f41-4cdd-b9bc-7a3627033f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:58 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Volume volume-41162dac-9509-49fd-9fbd-21a4b6067c58 (41162dac-9509-49fd-9fbd-21a4b6067c58): created successfully Sep 07 13:46:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19b7f443-5f41-4cdd-b9bc-7a3627033f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Flow 'volume_create_manager' (56d865c2-6a5e-474d-8890-9d88e844a1e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:58 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c8c80bdb-8559-4198-b0fc-3fa799c53882 tempest-GroupSnapshotsTest-1017917195 None] Created volume successfully. Sep 07 13:47:00 devstack sudo[92325]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2 1073741824" returned: 0 in 1.663s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:00 devstack sudo[92418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2 Sep 07 13:47:00 devstack sudo[92418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:00 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-9508b08f-218d-4428-9c65-acfa568ada53 tempest-GroupSnapshotsTest-1017917195 None] GroupSnapshot 129081fd-cf67-4589-a5fb-b9f3d756e052: creating. Sep 07 13:47:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9508b08f-218d-4428-9c65-acfa568ada53 tempest-GroupSnapshotsTest-1017917195 None] Group snapshot 129081fd-cf67-4589-a5fb-b9f3d756e052: creating. {{(pid=87571) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 13:47:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9508b08f-218d-4428-9c65-acfa568ada53 tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:00 devstack sudo[92418]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2" returned: 0 in 0.547s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:00 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] <== create_volume: return (2425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:47:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.437s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9508b08f-218d-4428-9c65-acfa568ada53 tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.327s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:00 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-9508b08f-218d-4428-9c65-acfa568ada53 tempest-GroupSnapshotsTest-1017917195 None] Creating offline snapshot ab70c6eb-d586-4d8c-a8b5-7e395262da3d of volume 41162dac-9509-49fd-9fbd-21a4b6067c58 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:47:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c11ad87f-85ec-4ddd-934a-464acc65ddb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3e1002-7622-49ff-983f-56c95fdeb9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:01 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8871e08-0cd0-4a35-a007-92966d178cb3]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9508b08f-218d-4428-9c65-acfa568ada53 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:01 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Volume volume-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2 (9d3cfbae-a7e0-4743-b4e5-334d8abd71d2): created successfully Sep 07 13:47:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3e1002-7622-49ff-983f-56c95fdeb9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Flow 'volume_create_manager' (8b0ca750-67d5-43ae-bf8d-f0c1f72cb5f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:01 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-5f689aad-a746-4f59-b06b-9a15eb94181a tempest-ServerActionsTestOtherA-611322616 None] Created volume successfully. Sep 07 13:47:01 devstack sudo[92427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58 Sep 07 13:47:01 devstack sudo[92427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:01 devstack sudo[92427]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9508b08f-218d-4428-9c65-acfa568ada53 tempest-GroupSnapshotsTest-1017917195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58" returned: 0 in 0.593s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9508b08f-218d-4428-9c65-acfa568ada53 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.ab70c6eb-d586-4d8c-a8b5-7e395262da3d 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:01 devstack sudo[92434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.ab70c6eb-d586-4d8c-a8b5-7e395262da3d 1G Sep 07 13:47:01 devstack sudo[92434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:02 devstack sudo[92434]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9508b08f-218d-4428-9c65-acfa568ada53 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.ab70c6eb-d586-4d8c-a8b5-7e395262da3d 1G" returned: 0 in 0.680s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9508b08f-218d-4428-9c65-acfa568ada53 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41162dac-9509-49fd-9fbd-21a4b6067c58 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.ab70c6eb-d586-4d8c-a8b5-7e395262da3d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:02 devstack sudo[92443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41162dac-9509-49fd-9fbd-21a4b6067c58 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.ab70c6eb-d586-4d8c-a8b5-7e395262da3d Sep 07 13:47:02 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:02 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9508b08f-218d-4428-9c65-acfa568ada53 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41162dac-9509-49fd-9fbd-21a4b6067c58 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.ab70c6eb-d586-4d8c-a8b5-7e395262da3d" returned: 0 in 0.565s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:02 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-9508b08f-218d-4428-9c65-acfa568ada53 tempest-GroupSnapshotsTest-1017917195 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.ab70c6eb-d586-4d8c-a8b5-7e395262da3d is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:47:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9508b08f-218d-4428-9c65-acfa568ada53 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.ab70c6eb-d586-4d8c-a8b5-7e395262da3d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:02 devstack sudo[92449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.ab70c6eb-d586-4d8c-a8b5-7e395262da3d Sep 07 13:47:02 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:03 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9508b08f-218d-4428-9c65-acfa568ada53 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.ab70c6eb-d586-4d8c-a8b5-7e395262da3d" returned: 0 in 0.568s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9508b08f-218d-4428-9c65-acfa568ada53 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:03 devstack sudo[92455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.info Sep 07 13:47:03 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:03 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9508b08f-218d-4428-9c65-acfa568ada53 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.info" returned: 0 in 0.372s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:03 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-9508b08f-218d-4428-9c65-acfa568ada53 tempest-GroupSnapshotsTest-1017917195 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:47:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9508b08f-218d-4428-9c65-acfa568ada53 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:03 devstack sudo[92463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.info Sep 07 13:47:03 devstack sudo[92463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:04 devstack sudo[92463]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9508b08f-218d-4428-9c65-acfa568ada53 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.info" returned: 0 in 0.317s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9508b08f-218d-4428-9c65-acfa568ada53 tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.373s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:04 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-9508b08f-218d-4428-9c65-acfa568ada53 tempest-GroupSnapshotsTest-1017917195 None] group_snapshot 129081fd-cf67-4589-a5fb-b9f3d756e052: created successfully Sep 07 13:47:05 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-6947321b-a212-496c-a8df-cd129c06eecb tempest-GroupSnapshotsTest-1017917195 None] group_snapshot 129081fd-cf67-4589-a5fb-b9f3d756e052: deleting Sep 07 13:47:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-6947321b-a212-496c-a8df-cd129c06eecb tempest-GroupSnapshotsTest-1017917195 None] group_snapshot 129081fd-cf67-4589-a5fb-b9f3d756e052: deleting {{(pid=87571) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 13:47:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6947321b-a212-496c-a8df-cd129c06eecb tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "cinder-quobyte-41162dac-9509-49fd-9fbd-21a4b6067c58" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6947321b-a212-496c-a8df-cd129c06eecb tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-41162dac-9509-49fd-9fbd-21a4b6067c58" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6947321b-a212-496c-a8df-cd129c06eecb tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "cinder-quobyte-ab70c6eb-d586-4d8c-a8b5-7e395262da3d" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6947321b-a212-496c-a8df-cd129c06eecb tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-ab70c6eb-d586-4d8c-a8b5-7e395262da3d" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-6947321b-a212-496c-a8df-cd129c06eecb tempest-GroupSnapshotsTest-1017917195 None] Deleting offline snapshot ab70c6eb-d586-4d8c-a8b5-7e395262da3d of volume 41162dac-9509-49fd-9fbd-21a4b6067c58 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:47:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-6947321b-a212-496c-a8df-cd129c06eecb tempest-GroupSnapshotsTest-1017917195 None] snapshot_file for this snap is: volume-41162dac-9509-49fd-9fbd-21a4b6067c58.ab70c6eb-d586-4d8c-a8b5-7e395262da3d {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:47:05 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[166265e5-a075-4ce2-ad0b-7a50f46d0435]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6947321b-a212-496c-a8df-cd129c06eecb tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.ab70c6eb-d586-4d8c-a8b5-7e395262da3d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:05 devstack sudo[92499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.ab70c6eb-d586-4d8c-a8b5-7e395262da3d Sep 07 13:47:05 devstack sudo[92499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:06 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-df71b2cc-ed3c-481c-b24a-d698aec9734b tempest-AttachVolumeTestJSON-58750255 None] Acquiring lock "cinder-0d6cb910-a117-47d1-980f-873e87b6d7f0-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:06 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-df71b2cc-ed3c-481c-b24a-d698aec9734b tempest-AttachVolumeTestJSON-58750255 None] Lock "cinder-0d6cb910-a117-47d1-980f-873e87b6d7f0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:06 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-df71b2cc-ed3c-481c-b24a-d698aec9734b tempest-AttachVolumeTestJSON-58750255 None] Acquiring lock "cinder-quobyte-0d6cb910-a117-47d1-980f-873e87b6d7f0" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:06 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-df71b2cc-ed3c-481c-b24a-d698aec9734b tempest-AttachVolumeTestJSON-58750255 None] Lock "cinder-quobyte-0d6cb910-a117-47d1-980f-873e87b6d7f0" acquired by "delete_volume" :: waited 0.045s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:06 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabe8021-a406-4993-802f-d093e23dec85]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-df71b2cc-ed3c-481c-b24a-d698aec9734b tempest-AttachVolumeTestJSON-58750255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d6cb910-a117-47d1-980f-873e87b6d7f0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:06 devstack sudo[92499]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6947321b-a212-496c-a8df-cd129c06eecb tempest-GroupSnapshotsTest-1017917195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.ab70c6eb-d586-4d8c-a8b5-7e395262da3d" returned: 0 in 0.917s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-6947321b-a212-496c-a8df-cd129c06eecb tempest-GroupSnapshotsTest-1017917195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41162dac-9509-49fd-9fbd-21a4b6067c58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:47:06 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e8d398-78dd-493c-ad48-938d34ab216a]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6947321b-a212-496c-a8df-cd129c06eecb tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:06 devstack sudo[92504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d6cb910-a117-47d1-980f-873e87b6d7f0 Sep 07 13:47:06 devstack sudo[92504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:06 devstack sudo[92506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58 Sep 07 13:47:06 devstack sudo[92506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:06 devstack sudo[92504]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-df71b2cc-ed3c-481c-b24a-d698aec9734b tempest-AttachVolumeTestJSON-58750255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d6cb910-a117-47d1-980f-873e87b6d7f0" returned: 0 in 0.743s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-df71b2cc-ed3c-481c-b24a-d698aec9734b tempest-AttachVolumeTestJSON-58750255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d6cb910-a117-47d1-980f-873e87b6d7f0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:07 devstack sudo[92514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d6cb910-a117-47d1-980f-873e87b6d7f0 Sep 07 13:47:07 devstack sudo[92514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:07 devstack sudo[92506]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6947321b-a212-496c-a8df-cd129c06eecb tempest-GroupSnapshotsTest-1017917195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58" returned: 0 in 0.790s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6947321b-a212-496c-a8df-cd129c06eecb tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.ab70c6eb-d586-4d8c-a8b5-7e395262da3d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:07 devstack sudo[92519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.ab70c6eb-d586-4d8c-a8b5-7e395262da3d Sep 07 13:47:07 devstack sudo[92519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:07 devstack sudo[92514]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-df71b2cc-ed3c-481c-b24a-d698aec9734b tempest-AttachVolumeTestJSON-58750255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d6cb910-a117-47d1-980f-873e87b6d7f0" returned: 0 in 0.463s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:07 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-df71b2cc-ed3c-481c-b24a-d698aec9734b tempest-AttachVolumeTestJSON-58750255 None] Lock "cinder-quobyte-0d6cb910-a117-47d1-980f-873e87b6d7f0" released by "delete_volume" :: held 1.308s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:07 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-df71b2cc-ed3c-481c-b24a-d698aec9734b tempest-AttachVolumeTestJSON-58750255 None] Created reservations ['2b2ef6c5-df79-4763-afc9-5384b3b3fe70', '4f33f020-0a52-45c4-a209-19502a1a3d04', '33707fc0-5516-43e9-a3c3-5dad76b6873d', '5d8be607-35ea-45bd-b0dd-6d51a3326492'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:47:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-df71b2cc-ed3c-481c-b24a-d698aec9734b tempest-AttachVolumeTestJSON-58750255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-df71b2cc-ed3c-481c-b24a-d698aec9734b tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-df71b2cc-ed3c-481c-b24a-d698aec9734b tempest-AttachVolumeTestJSON-58750255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-df71b2cc-ed3c-481c-b24a-d698aec9734b tempest-AttachVolumeTestJSON-58750255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-df71b2cc-ed3c-481c-b24a-d698aec9734b tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-df71b2cc-ed3c-481c-b24a-d698aec9734b tempest-AttachVolumeTestJSON-58750255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6947321b-a212-496c-a8df-cd129c06eecb tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.ab70c6eb-d586-4d8c-a8b5-7e395262da3d" returned: 0 in 0.858s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:08 devstack sudo[92519]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:08 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:47:08 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6947321b-a212-496c-a8df-cd129c06eecb tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.ab70c6eb-d586-4d8c-a8b5-7e395262da3d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:08 devstack sudo[92546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.ab70c6eb-d586-4d8c-a8b5-7e395262da3d Sep 07 13:47:08 devstack sudo[92546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:08 devstack sudo[92546]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6947321b-a212-496c-a8df-cd129c06eecb tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58.ab70c6eb-d586-4d8c-a8b5-7e395262da3d" returned: 0 in 0.443s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6947321b-a212-496c-a8df-cd129c06eecb tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-ab70c6eb-d586-4d8c-a8b5-7e395262da3d" released by "_delete_snapshot" :: held 3.216s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6947321b-a212-496c-a8df-cd129c06eecb tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-41162dac-9509-49fd-9fbd-21a4b6067c58" released by "delete_snapshot" :: held 3.267s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:08 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7a4101c5-f93a-4c01-97d4-1c3bb66aae02 tempest-AttachVolumeTestJSON-58750255 None] Acquiring lock "cinder-ce192be7-0607-4fbf-9403-1cd4f91d4da2-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-df71b2cc-ed3c-481c-b24a-d698aec9734b tempest-AttachVolumeTestJSON-58750255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.693s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:08 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-df71b2cc-ed3c-481c-b24a-d698aec9734b tempest-AttachVolumeTestJSON-58750255 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:47:08 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-df71b2cc-ed3c-481c-b24a-d698aec9734b tempest-AttachVolumeTestJSON-58750255 None] Deleted volume successfully. Sep 07 13:47:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7a4101c5-f93a-4c01-97d4-1c3bb66aae02 tempest-AttachVolumeTestJSON-58750255 None] Lock "cinder-ce192be7-0607-4fbf-9403-1cd4f91d4da2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-df71b2cc-ed3c-481c-b24a-d698aec9734b tempest-AttachVolumeTestJSON-58750255 None] Lock "cinder-0d6cb910-a117-47d1-980f-873e87b6d7f0-delete_volume" released by "delete_volume" :: held 2.749s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7a4101c5-f93a-4c01-97d4-1c3bb66aae02 tempest-AttachVolumeTestJSON-58750255 None] Acquiring lock "cinder-quobyte-ce192be7-0607-4fbf-9403-1cd4f91d4da2" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:08 devstack cinder-volume[87571]: WARNING cinder.quota [None req-6947321b-a212-496c-a8df-cd129c06eecb tempest-GroupSnapshotsTest-1017917195 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1366810464 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1366810464, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:47:08 devstack cinder-volume[87571]: WARNING cinder.quota [None req-6947321b-a212-496c-a8df-cd129c06eecb tempest-GroupSnapshotsTest-1017917195 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1366810464 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1366810464, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:47:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7a4101c5-f93a-4c01-97d4-1c3bb66aae02 tempest-AttachVolumeTestJSON-58750255 None] Lock "cinder-quobyte-ce192be7-0607-4fbf-9403-1cd4f91d4da2" acquired by "delete_volume" :: waited 0.061s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:08 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd91c16-773a-4a59-aed7-00584124f1eb]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7a4101c5-f93a-4c01-97d4-1c3bb66aae02 tempest-AttachVolumeTestJSON-58750255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce192be7-0607-4fbf-9403-1cd4f91d4da2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:08 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-6947321b-a212-496c-a8df-cd129c06eecb tempest-GroupSnapshotsTest-1017917195 None] Created reservations ['95b96849-95ce-4f9e-ba29-ffe86dce00e2', '96dc866c-0621-4483-996d-36a0a2f1b9bf', '5f0de137-feba-40cd-bab4-36a3e1ee835c', '8a07698a-9a14-4c63-a7f8-10fff03dfd6e'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:47:09 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-6947321b-a212-496c-a8df-cd129c06eecb tempest-GroupSnapshotsTest-1017917195 None] group_snapshot 129081fd-cf67-4589-a5fb-b9f3d756e052: deleted successfully Sep 07 13:47:09 devstack sudo[92556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce192be7-0607-4fbf-9403-1cd4f91d4da2 Sep 07 13:47:09 devstack sudo[92556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:09 devstack sudo[92556]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7a4101c5-f93a-4c01-97d4-1c3bb66aae02 tempest-AttachVolumeTestJSON-58750255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce192be7-0607-4fbf-9403-1cd4f91d4da2" returned: 0 in 0.721s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7a4101c5-f93a-4c01-97d4-1c3bb66aae02 tempest-AttachVolumeTestJSON-58750255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce192be7-0607-4fbf-9403-1cd4f91d4da2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:09 devstack sudo[92575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce192be7-0607-4fbf-9403-1cd4f91d4da2 Sep 07 13:47:09 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:10 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7a4101c5-f93a-4c01-97d4-1c3bb66aae02 tempest-AttachVolumeTestJSON-58750255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce192be7-0607-4fbf-9403-1cd4f91d4da2" returned: 0 in 0.552s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7a4101c5-f93a-4c01-97d4-1c3bb66aae02 tempest-AttachVolumeTestJSON-58750255 None] Lock "cinder-quobyte-ce192be7-0607-4fbf-9403-1cd4f91d4da2" released by "delete_volume" :: held 1.352s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:10 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=109,cinder:UPDATE=103,cinder:INSERT=21,cinder:DELETE=3 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:47:10 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=106,cinder:INSERT=23,cinder:UPDATE=93,cinder:DELETE=5 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:47:10 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-7a4101c5-f93a-4c01-97d4-1c3bb66aae02 tempest-AttachVolumeTestJSON-58750255 None] Created reservations ['8bee5ee0-4794-4120-8a42-13b7fbe3a29e', '8108f081-b965-44ff-8e6a-be25eb4b6212', '8a118c2c-aca8-4075-b8be-567b178a29f5', '800a5d7d-e350-410a-b11c-4ca6ce05dd47'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:47:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-10f12c2d-bc5b-4655-aba0-6988cfaca857 tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "cinder-quobyte-41162dac-9509-49fd-9fbd-21a4b6067c58" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7a4101c5-f93a-4c01-97d4-1c3bb66aae02 tempest-AttachVolumeTestJSON-58750255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7a4101c5-f93a-4c01-97d4-1c3bb66aae02 tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7a4101c5-f93a-4c01-97d4-1c3bb66aae02 tempest-AttachVolumeTestJSON-58750255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7a4101c5-f93a-4c01-97d4-1c3bb66aae02 tempest-AttachVolumeTestJSON-58750255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7a4101c5-f93a-4c01-97d4-1c3bb66aae02 tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7a4101c5-f93a-4c01-97d4-1c3bb66aae02 tempest-AttachVolumeTestJSON-58750255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-10f12c2d-bc5b-4655-aba0-6988cfaca857 tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-41162dac-9509-49fd-9fbd-21a4b6067c58" acquired by "delete_volume" :: waited 0.048s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:10 devstack sudo[92586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:47:10 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:10 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb3193e-894b-4473-9233-3b554d320613]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-10f12c2d-bc5b-4655-aba0-6988cfaca857 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:10 devstack sudo[92597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58 Sep 07 13:47:10 devstack sudo[92597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:10 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7a4101c5-f93a-4c01-97d4-1c3bb66aae02 tempest-AttachVolumeTestJSON-58750255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.409s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:10 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-7a4101c5-f93a-4c01-97d4-1c3bb66aae02 tempest-AttachVolumeTestJSON-58750255 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:47:10 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-7a4101c5-f93a-4c01-97d4-1c3bb66aae02 tempest-AttachVolumeTestJSON-58750255 None] Deleted volume successfully. Sep 07 13:47:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7a4101c5-f93a-4c01-97d4-1c3bb66aae02 tempest-AttachVolumeTestJSON-58750255 None] Lock "cinder-ce192be7-0607-4fbf-9403-1cd4f91d4da2-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:11 devstack sudo[92597]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-10f12c2d-bc5b-4655-aba0-6988cfaca857 tempest-GroupSnapshotsTest-1017917195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58" returned: 0 in 0.439s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-10f12c2d-bc5b-4655-aba0-6988cfaca857 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:11 devstack sudo[92613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58 Sep 07 13:47:11 devstack sudo[92613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-aac10a2f-cd32-44ef-a127-c7df306e92be tempest-AttachVolumeTestJSON-58750255 None] Acquiring lock "cinder-ea03c3bc-5df2-4e16-9406-7e67afa420ed-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-aac10a2f-cd32-44ef-a127-c7df306e92be tempest-AttachVolumeTestJSON-58750255 None] Lock "cinder-ea03c3bc-5df2-4e16-9406-7e67afa420ed-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:11 devstack sudo[92613]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-10f12c2d-bc5b-4655-aba0-6988cfaca857 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-41162dac-9509-49fd-9fbd-21a4b6067c58" returned: 0 in 0.412s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-aac10a2f-cd32-44ef-a127-c7df306e92be tempest-AttachVolumeTestJSON-58750255 None] Acquiring lock "cinder-quobyte-ea03c3bc-5df2-4e16-9406-7e67afa420ed" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-10f12c2d-bc5b-4655-aba0-6988cfaca857 tempest-GroupSnapshotsTest-1017917195 None] Lock "cinder-quobyte-41162dac-9509-49fd-9fbd-21a4b6067c58" released by "delete_volume" :: held 0.964s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-aac10a2f-cd32-44ef-a127-c7df306e92be tempest-AttachVolumeTestJSON-58750255 None] Lock "cinder-quobyte-ea03c3bc-5df2-4e16-9406-7e67afa420ed" acquired by "delete_volume" :: waited 0.024s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:11 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[704281fd-317f-45c5-9cea-fa6e5d8bac9d]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-aac10a2f-cd32-44ef-a127-c7df306e92be tempest-AttachVolumeTestJSON-58750255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ea03c3bc-5df2-4e16-9406-7e67afa420ed {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:11 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-10f12c2d-bc5b-4655-aba0-6988cfaca857 tempest-GroupSnapshotsTest-1017917195 None] Created reservations ['a4401533-08da-4caa-b2d9-2cd42faf60f4'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:47:11 devstack sudo[92617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ea03c3bc-5df2-4e16-9406-7e67afa420ed Sep 07 13:47:11 devstack sudo[92617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:11 devstack cinder-volume[87571]: WARNING cinder.quota [None req-10f12c2d-bc5b-4655-aba0-6988cfaca857 tempest-GroupSnapshotsTest-1017917195 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1366810464 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1366810464, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:47:11 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-10f12c2d-bc5b-4655-aba0-6988cfaca857 tempest-GroupSnapshotsTest-1017917195 None] Created reservations ['a483bf3d-ea8b-46b1-821d-9a77cf004407', '7d19a5a2-4102-486b-b781-7d5c638c48bb', 'd56720d7-5422-4076-92c2-bf2a0fae2151', 'e9bdfda9-9dd3-4626-aceb-5a746d13b3bc'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-10f12c2d-bc5b-4655-aba0-6988cfaca857 tempest-GroupSnapshotsTest-1017917195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-10f12c2d-bc5b-4655-aba0-6988cfaca857 tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-10f12c2d-bc5b-4655-aba0-6988cfaca857 tempest-GroupSnapshotsTest-1017917195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:12 devstack sudo[92617]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-10f12c2d-bc5b-4655-aba0-6988cfaca857 tempest-GroupSnapshotsTest-1017917195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-10f12c2d-bc5b-4655-aba0-6988cfaca857 tempest-GroupSnapshotsTest-1017917195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-10f12c2d-bc5b-4655-aba0-6988cfaca857 tempest-GroupSnapshotsTest-1017917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-aac10a2f-cd32-44ef-a127-c7df306e92be tempest-AttachVolumeTestJSON-58750255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ea03c3bc-5df2-4e16-9406-7e67afa420ed" returned: 0 in 0.542s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-aac10a2f-cd32-44ef-a127-c7df306e92be tempest-AttachVolumeTestJSON-58750255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ea03c3bc-5df2-4e16-9406-7e67afa420ed {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:12 devstack sudo[92623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:47:12 devstack sudo[92624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ea03c3bc-5df2-4e16-9406-7e67afa420ed Sep 07 13:47:12 devstack sudo[92624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:12 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:12 devstack sudo[92624]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-aac10a2f-cd32-44ef-a127-c7df306e92be tempest-AttachVolumeTestJSON-58750255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ea03c3bc-5df2-4e16-9406-7e67afa420ed" returned: 0 in 0.398s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-aac10a2f-cd32-44ef-a127-c7df306e92be tempest-AttachVolumeTestJSON-58750255 None] Lock "cinder-quobyte-ea03c3bc-5df2-4e16-9406-7e67afa420ed" released by "delete_volume" :: held 1.025s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:12 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-10f12c2d-bc5b-4655-aba0-6988cfaca857 tempest-GroupSnapshotsTest-1017917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.499s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-10f12c2d-bc5b-4655-aba0-6988cfaca857 tempest-GroupSnapshotsTest-1017917195 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:47:12 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-10f12c2d-bc5b-4655-aba0-6988cfaca857 tempest-GroupSnapshotsTest-1017917195 None] Delete group completed successfully. Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-aac10a2f-cd32-44ef-a127-c7df306e92be tempest-AttachVolumeTestJSON-58750255 None] Created reservations ['be3fd522-c130-4beb-8ff6-ab48ee94c621', '43f84b70-eee9-40c1-b61f-454db9d49d2d', 'bc1bc22e-21c0-437c-a023-ec089408be7c', 'd7e57a7c-318c-4332-9b74-dce9a3623ed4'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-aac10a2f-cd32-44ef-a127-c7df306e92be tempest-AttachVolumeTestJSON-58750255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-aac10a2f-cd32-44ef-a127-c7df306e92be tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-aac10a2f-cd32-44ef-a127-c7df306e92be tempest-AttachVolumeTestJSON-58750255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-aac10a2f-cd32-44ef-a127-c7df306e92be tempest-AttachVolumeTestJSON-58750255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-aac10a2f-cd32-44ef-a127-c7df306e92be tempest-AttachVolumeTestJSON-58750255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-aac10a2f-cd32-44ef-a127-c7df306e92be tempest-AttachVolumeTestJSON-58750255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-bc3b0f82-7899-4966-a457-5e14a0001940 tempest-ServerRescueNegativeTestJSON-2101076822 None] Acquiring lock "cinder-8d447148-ab86-4007-bc49-ecd70d4e898e-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-bc3b0f82-7899-4966-a457-5e14a0001940 tempest-ServerRescueNegativeTestJSON-2101076822 None] Lock "cinder-8d447148-ab86-4007-bc49-ecd70d4e898e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:12 devstack sudo[92632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:47:12 devstack sudo[92632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-bc3b0f82-7899-4966-a457-5e14a0001940 tempest-ServerRescueNegativeTestJSON-2101076822 None] Acquiring lock "cinder-quobyte-8d447148-ab86-4007-bc49-ecd70d4e898e" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-bc3b0f82-7899-4966-a457-5e14a0001940 tempest-ServerRescueNegativeTestJSON-2101076822 None] Lock "cinder-quobyte-8d447148-ab86-4007-bc49-ecd70d4e898e" acquired by "delete_volume" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c94a350-3571-4593-8b4f-b16354876b7a]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bc3b0f82-7899-4966-a457-5e14a0001940 tempest-ServerRescueNegativeTestJSON-2101076822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8d447148-ab86-4007-bc49-ecd70d4e898e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:13 devstack sudo[92634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8d447148-ab86-4007-bc49-ecd70d4e898e Sep 07 13:47:13 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:13 devstack sudo[92632]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-aac10a2f-cd32-44ef-a127-c7df306e92be tempest-AttachVolumeTestJSON-58750255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.613s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:13 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-aac10a2f-cd32-44ef-a127-c7df306e92be tempest-AttachVolumeTestJSON-58750255 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:47:13 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-aac10a2f-cd32-44ef-a127-c7df306e92be tempest-AttachVolumeTestJSON-58750255 None] Deleted volume successfully. Sep 07 13:47:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-aac10a2f-cd32-44ef-a127-c7df306e92be tempest-AttachVolumeTestJSON-58750255 None] Lock "cinder-ea03c3bc-5df2-4e16-9406-7e67afa420ed-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:13 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bc3b0f82-7899-4966-a457-5e14a0001940 tempest-ServerRescueNegativeTestJSON-2101076822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8d447148-ab86-4007-bc49-ecd70d4e898e" returned: 0 in 0.542s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bc3b0f82-7899-4966-a457-5e14a0001940 tempest-ServerRescueNegativeTestJSON-2101076822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8d447148-ab86-4007-bc49-ecd70d4e898e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:13 devstack sudo[92640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8d447148-ab86-4007-bc49-ecd70d4e898e Sep 07 13:47:13 devstack sudo[92640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:14 devstack sudo[92640]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bc3b0f82-7899-4966-a457-5e14a0001940 tempest-ServerRescueNegativeTestJSON-2101076822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8d447148-ab86-4007-bc49-ecd70d4e898e" returned: 0 in 0.868s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:14 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-bc3b0f82-7899-4966-a457-5e14a0001940 tempest-ServerRescueNegativeTestJSON-2101076822 None] Lock "cinder-quobyte-8d447148-ab86-4007-bc49-ecd70d4e898e" released by "delete_volume" :: held 1.522s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:14 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-bc3b0f82-7899-4966-a457-5e14a0001940 tempest-ServerRescueNegativeTestJSON-2101076822 None] Created reservations ['ae13de1c-5e26-4972-b9e5-03ea18eae384', '897e8755-34f8-481b-84e4-8fa3cb9a02b8', 'e6ecb4f5-f360-4451-9268-1ccb851f288a', 'f03c0e64-ffba-41f1-add4-86390f520cd5'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:47:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-bc3b0f82-7899-4966-a457-5e14a0001940 tempest-ServerRescueNegativeTestJSON-2101076822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-bc3b0f82-7899-4966-a457-5e14a0001940 tempest-ServerRescueNegativeTestJSON-2101076822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-bc3b0f82-7899-4966-a457-5e14a0001940 tempest-ServerRescueNegativeTestJSON-2101076822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-bc3b0f82-7899-4966-a457-5e14a0001940 tempest-ServerRescueNegativeTestJSON-2101076822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-bc3b0f82-7899-4966-a457-5e14a0001940 tempest-ServerRescueNegativeTestJSON-2101076822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bc3b0f82-7899-4966-a457-5e14a0001940 tempest-ServerRescueNegativeTestJSON-2101076822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:14 devstack sudo[92681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:47:14 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bc3b0f82-7899-4966-a457-5e14a0001940 tempest-ServerRescueNegativeTestJSON-2101076822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.497s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:15 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:15 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-bc3b0f82-7899-4966-a457-5e14a0001940 tempest-ServerRescueNegativeTestJSON-2101076822 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:47:15 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-bc3b0f82-7899-4966-a457-5e14a0001940 tempest-ServerRescueNegativeTestJSON-2101076822 None] Deleted volume successfully. Sep 07 13:47:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-bc3b0f82-7899-4966-a457-5e14a0001940 tempest-ServerRescueNegativeTestJSON-2101076822 None] Lock "cinder-8d447148-ab86-4007-bc49-ecd70d4e898e-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:24 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:UPDATE=33,cinder:SELECT=19,cinder:INSERT=8 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:47:25 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=24,cinder:INSERT=9,cinder:UPDATE=35,cinder:DELETE=3 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:47:27 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-638522ae-7549-422c-bb9f-003cd1f2fa24 tempest-GroupsTest-1487486140 None] Group tempest-Group1-840459865: creating Sep 07 13:47:27 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-638522ae-7549-422c-bb9f-003cd1f2fa24 tempest-GroupsTest-1487486140 None] Group tempest-Group1-840459865: created successfully Sep 07 13:47:27 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-638522ae-7549-422c-bb9f-003cd1f2fa24 tempest-GroupsTest-1487486140 None] Create group completed successfully. Sep 07 13:47:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:47:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:28 devstack sudo[92752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:47:28 devstack sudo[92752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:28 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-31ab89a4-58f0-409b-8cde-3bc33f014375 tempest-GroupsTest-1487486140 None] Group tempest-Group2-1356351883: creating Sep 07 13:47:28 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-31ab89a4-58f0-409b-8cde-3bc33f014375 tempest-GroupsTest-1487486140 None] Group tempest-Group2-1356351883: created successfully Sep 07 13:47:28 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-31ab89a4-58f0-409b-8cde-3bc33f014375 tempest-GroupsTest-1487486140 None] Create group completed successfully. Sep 07 13:47:28 devstack sudo[92752]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.444s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:47:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager._thread_info {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:47:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread count: 8 {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:47:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread info: [<_MainThread(MainThread, started 132147689414784)>, , , , , , , ] {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:47:29 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:47:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Flow 'volume_create_manager' (3ac8467f-9684-4c23-84ff-8c77188e96c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce871590-6480-41cc-bbd8-050d8007a71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce871590-6480-41cc-bbd8-050d8007a71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-430616725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3019ab6-b0a5-4524-a8f0-523ac974345b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c0b057b91d5f4f1394fba4ec480509fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:30Z,use_quota=True,user_id='48eeda8b4ec545398c9282b053c0df2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9612725e-8df7-4525-a52b-fa5c20bf0511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9612725e-8df7-4525-a52b-fa5c20bf0511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8ea4ed-36e2-4e83-a083-955860ab97e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8ea4ed-36e2-4e83-a083-955860ab97e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3019ab6-b0a5-4524-a8f0-523ac974345b', 'volume_name': 'volume-f3019ab6-b0a5-4524-a8f0-523ac974345b', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b950255-b717-4929-8cf3-688acfcd8aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b950255-b717-4929-8cf3-688acfcd8aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a054e13-b967-4a3b-a399-bbd3f57cf0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:29 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Volume f3019ab6-b0a5-4524-a8f0-523ac974345b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3019ab6-b0a5-4524-a8f0-523ac974345b', 'volume_size': 1} Sep 07 13:47:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-430616725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3019ab6-b0a5-4524-a8f0-523ac974345b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c0b057b91d5f4f1394fba4ec480509fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:30Z,use_quota=True,user_id='48eeda8b4ec545398c9282b053c0df2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:47:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Creating volume f3019ab6-b0a5-4524-a8f0-523ac974345b {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:47:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:47:29 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:47:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f3019ab6-b0a5-4524-a8f0-523ac974345b 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:29 devstack sudo[92768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f3019ab6-b0a5-4524-a8f0-523ac974345b 1073741824 Sep 07 13:47:29 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Flow 'volume_create_manager' (7ca6ae3a-1cab-4ef0-b233-c39b6c022e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:30 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd3714a5-e088-4063-b84f-35266cd06929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f3019ab6-b0a5-4524-a8f0-523ac974345b 1073741824" returned: 0 in 0.689s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd3714a5-e088-4063-b84f-35266cd06929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2095676878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be8b6879-05ca-4d4a-914a-9239b1487dda,host='devstack@QuobyteHD#QuobyteHD',id=2fd28f23-2d71-40bf-a31d-7091b9ddb3ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d42c308b091d4d3296d2c14a14ba0610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:30Z,use_quota=True,user_id='210712260fcc44829d7ce8ec31a29084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95df1687-082b-47b9-b407-8b5796852553),volume_type_id=95df1687-082b-47b9-b407-8b5796852553)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31593fd0-19f1-4e32-81b8-b228703daa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31593fd0-19f1-4e32-81b8-b228703daa5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e89f628-b566-40e8-b346-7eb006c87b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e89f628-b566-40e8-b346-7eb006c87b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fd28f23-2d71-40bf-a31d-7091b9ddb3ab', 'volume_name': 'volume-2fd28f23-2d71-40bf-a31d-7091b9ddb3ab', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2eb35e1-e74a-4b0a-90e4-4fd4c42345bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2eb35e1-e74a-4b0a-90e4-4fd4c42345bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe5b0842-ca8f-4b14-8ba2-270c890fcd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:30 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Volume 2fd28f23-2d71-40bf-a31d-7091b9ddb3ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fd28f23-2d71-40bf-a31d-7091b9ddb3ab', 'volume_size': 1} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f3019ab6-b0a5-4524-a8f0-523ac974345b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:30 devstack sudo[92777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f3019ab6-b0a5-4524-a8f0-523ac974345b Sep 07 13:47:30 devstack sudo[92777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:30 devstack sudo[92777]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f3019ab6-b0a5-4524-a8f0-523ac974345b" returned: 0 in 0.257s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.308s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=be8b6879-05ca-4d4a-914a-9239b1487dda,created_at=2026-09-07T11:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2095676878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be8b6879-05ca-4d4a-914a-9239b1487dda,host='devstack@QuobyteHD#QuobyteHD',id=2fd28f23-2d71-40bf-a31d-7091b9ddb3ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d42c308b091d4d3296d2c14a14ba0610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:30Z,use_quota=True,user_id='210712260fcc44829d7ce8ec31a29084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95df1687-082b-47b9-b407-8b5796852553),volume_type_id=95df1687-082b-47b9-b407-8b5796852553)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Creating volume 2fd28f23-2d71-40bf-a31d-7091b9ddb3ab {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:47:30 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2fd28f23-2d71-40bf-a31d-7091b9ddb3ab 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a054e13-b967-4a3b-a399-bbd3f57cf0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3019ab6-b0a5-4524-a8f0-523ac974345b', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69c9399-b465-4a85-ba80-c654ae5f3c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:30 devstack sudo[92780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2fd28f23-2d71-40bf-a31d-7091b9ddb3ab 1073741824 Sep 07 13:47:30 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:30 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Volume volume-f3019ab6-b0a5-4524-a8f0-523ac974345b (f3019ab6-b0a5-4524-a8f0-523ac974345b): created successfully Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69c9399-b465-4a85-ba80-c654ae5f3c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Flow 'volume_create_manager' (3ac8467f-9684-4c23-84ff-8c77188e96c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:30 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-2ddf64ad-4bcf-404f-b693-4955f79d6cda req-1062a978-84cf-4011-b700-c263492ec1b5 tempest-VolumesGetTestJSON-1818234360 None] Created volume successfully. Sep 07 13:47:31 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2fd28f23-2d71-40bf-a31d-7091b9ddb3ab 1073741824" returned: 0 in 0.414s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2fd28f23-2d71-40bf-a31d-7091b9ddb3ab {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:31 devstack sudo[92786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2fd28f23-2d71-40bf-a31d-7091b9ddb3ab Sep 07 13:47:31 devstack sudo[92786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:31 devstack sudo[92786]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2fd28f23-2d71-40bf-a31d-7091b9ddb3ab" returned: 0 in 0.301s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:47:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe5b0842-ca8f-4b14-8ba2-270c890fcd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd28f23-2d71-40bf-a31d-7091b9ddb3ab', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002187e4-2b85-47c2-b512-d26532db6c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:31 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Volume volume-2fd28f23-2d71-40bf-a31d-7091b9ddb3ab (2fd28f23-2d71-40bf-a31d-7091b9ddb3ab): created successfully Sep 07 13:47:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002187e4-2b85-47c2-b512-d26532db6c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Flow 'volume_create_manager' (7ca6ae3a-1cab-4ef0-b233-c39b6c022e1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:31 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-1123b7f8-2886-4559-89a9-ffc0743f1e3d tempest-GroupsTest-1487486140 None] Created volume successfully. Sep 07 13:47:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-7a2dddc6-e612-476d-8cd6-1c9d900f4afd req-c56cfa76-599d-4dde-adac-809f7452dad0 tempest-VolumesGetTestJSON-1818234360 None] Acquiring lock "cinder-f3019ab6-b0a5-4524-a8f0-523ac974345b-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-7a2dddc6-e612-476d-8cd6-1c9d900f4afd req-c56cfa76-599d-4dde-adac-809f7452dad0 tempest-VolumesGetTestJSON-1818234360 None] Lock "cinder-f3019ab6-b0a5-4524-a8f0-523ac974345b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-7a2dddc6-e612-476d-8cd6-1c9d900f4afd req-c56cfa76-599d-4dde-adac-809f7452dad0 tempest-VolumesGetTestJSON-1818234360 None] Acquiring lock "cinder-quobyte-f3019ab6-b0a5-4524-a8f0-523ac974345b" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-7a2dddc6-e612-476d-8cd6-1c9d900f4afd req-c56cfa76-599d-4dde-adac-809f7452dad0 tempest-VolumesGetTestJSON-1818234360 None] Lock "cinder-quobyte-f3019ab6-b0a5-4524-a8f0-523ac974345b" acquired by "delete_volume" :: waited 0.019s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:32 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[960a594a-9faa-44e2-a9bb-f14fe1a721f9]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-7a2dddc6-e612-476d-8cd6-1c9d900f4afd req-c56cfa76-599d-4dde-adac-809f7452dad0 tempest-VolumesGetTestJSON-1818234360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f3019ab6-b0a5-4524-a8f0-523ac974345b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:32 devstack sudo[92789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f3019ab6-b0a5-4524-a8f0-523ac974345b Sep 07 13:47:32 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:32 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-7a2dddc6-e612-476d-8cd6-1c9d900f4afd req-c56cfa76-599d-4dde-adac-809f7452dad0 tempest-VolumesGetTestJSON-1818234360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f3019ab6-b0a5-4524-a8f0-523ac974345b" returned: 0 in 0.409s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-7a2dddc6-e612-476d-8cd6-1c9d900f4afd req-c56cfa76-599d-4dde-adac-809f7452dad0 tempest-VolumesGetTestJSON-1818234360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f3019ab6-b0a5-4524-a8f0-523ac974345b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:32 devstack sudo[92795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f3019ab6-b0a5-4524-a8f0-523ac974345b Sep 07 13:47:32 devstack sudo[92795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:32 devstack sudo[92795]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-7a2dddc6-e612-476d-8cd6-1c9d900f4afd req-c56cfa76-599d-4dde-adac-809f7452dad0 tempest-VolumesGetTestJSON-1818234360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f3019ab6-b0a5-4524-a8f0-523ac974345b" returned: 0 in 0.279s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-7a2dddc6-e612-476d-8cd6-1c9d900f4afd req-c56cfa76-599d-4dde-adac-809f7452dad0 tempest-VolumesGetTestJSON-1818234360 None] Lock "cinder-quobyte-f3019ab6-b0a5-4524-a8f0-523ac974345b" released by "delete_volume" :: held 0.736s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:32 devstack cinder-volume[87571]: DEBUG cinder.quota [req-7a2dddc6-e612-476d-8cd6-1c9d900f4afd req-c56cfa76-599d-4dde-adac-809f7452dad0 tempest-VolumesGetTestJSON-1818234360 None] Created reservations ['46f45a94-eacb-4bf9-9a8b-fd49fbeb08ce', '7cc27577-0737-43da-8a0d-362964d8f4c0', 'fe72ff8e-3f80-49d2-95c4-42632986e1b0', 'aa1d427b-dab6-4217-8a11-cae19e9d82a6'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:47:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-7a2dddc6-e612-476d-8cd6-1c9d900f4afd req-c56cfa76-599d-4dde-adac-809f7452dad0 tempest-VolumesGetTestJSON-1818234360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-7a2dddc6-e612-476d-8cd6-1c9d900f4afd req-c56cfa76-599d-4dde-adac-809f7452dad0 tempest-VolumesGetTestJSON-1818234360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [req-7a2dddc6-e612-476d-8cd6-1c9d900f4afd req-c56cfa76-599d-4dde-adac-809f7452dad0 tempest-VolumesGetTestJSON-1818234360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [req-7a2dddc6-e612-476d-8cd6-1c9d900f4afd req-c56cfa76-599d-4dde-adac-809f7452dad0 tempest-VolumesGetTestJSON-1818234360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-7a2dddc6-e612-476d-8cd6-1c9d900f4afd req-c56cfa76-599d-4dde-adac-809f7452dad0 tempest-VolumesGetTestJSON-1818234360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-7a2dddc6-e612-476d-8cd6-1c9d900f4afd req-c56cfa76-599d-4dde-adac-809f7452dad0 tempest-VolumesGetTestJSON-1818234360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:33 devstack sudo[92798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:47:33 devstack sudo[92798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:33 devstack sudo[92798]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-7a2dddc6-e612-476d-8cd6-1c9d900f4afd req-c56cfa76-599d-4dde-adac-809f7452dad0 tempest-VolumesGetTestJSON-1818234360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.290s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:33 devstack cinder-volume[87571]: DEBUG cinder.manager [req-7a2dddc6-e612-476d-8cd6-1c9d900f4afd req-c56cfa76-599d-4dde-adac-809f7452dad0 tempest-VolumesGetTestJSON-1818234360 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:47:33 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-7a2dddc6-e612-476d-8cd6-1c9d900f4afd req-c56cfa76-599d-4dde-adac-809f7452dad0 tempest-VolumesGetTestJSON-1818234360 None] Deleted volume successfully. Sep 07 13:47:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-7a2dddc6-e612-476d-8cd6-1c9d900f4afd req-c56cfa76-599d-4dde-adac-809f7452dad0 tempest-VolumesGetTestJSON-1818234360 None] Lock "cinder-f3019ab6-b0a5-4524-a8f0-523ac974345b-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-beb7b1ae-ec67-4810-ae36-f0fa6624dc86 tempest-GroupsTest-1487486140 None] Acquiring lock "cinder-quobyte-2fd28f23-2d71-40bf-a31d-7091b9ddb3ab" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-beb7b1ae-ec67-4810-ae36-f0fa6624dc86 tempest-GroupsTest-1487486140 None] Lock "cinder-quobyte-2fd28f23-2d71-40bf-a31d-7091b9ddb3ab" acquired by "delete_volume" :: waited 0.019s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:33 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12b7544-072e-4185-ab43-9472cb6233cf]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-beb7b1ae-ec67-4810-ae36-f0fa6624dc86 tempest-GroupsTest-1487486140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2fd28f23-2d71-40bf-a31d-7091b9ddb3ab {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:33 devstack sudo[92801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2fd28f23-2d71-40bf-a31d-7091b9ddb3ab Sep 07 13:47:33 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:34 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-beb7b1ae-ec67-4810-ae36-f0fa6624dc86 tempest-GroupsTest-1487486140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2fd28f23-2d71-40bf-a31d-7091b9ddb3ab" returned: 0 in 0.403s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-beb7b1ae-ec67-4810-ae36-f0fa6624dc86 tempest-GroupsTest-1487486140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2fd28f23-2d71-40bf-a31d-7091b9ddb3ab {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:34 devstack sudo[92807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2fd28f23-2d71-40bf-a31d-7091b9ddb3ab Sep 07 13:47:34 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:34 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-beb7b1ae-ec67-4810-ae36-f0fa6624dc86 tempest-GroupsTest-1487486140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-2fd28f23-2d71-40bf-a31d-7091b9ddb3ab" returned: 0 in 0.324s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-beb7b1ae-ec67-4810-ae36-f0fa6624dc86 tempest-GroupsTest-1487486140 None] Lock "cinder-quobyte-2fd28f23-2d71-40bf-a31d-7091b9ddb3ab" released by "delete_volume" :: held 0.787s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:34 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-beb7b1ae-ec67-4810-ae36-f0fa6624dc86 tempest-GroupsTest-1487486140 None] Created reservations ['fa6e213e-8692-4722-bd12-230e4d7f9082'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:47:34 devstack cinder-volume[87571]: WARNING cinder.quota [None req-beb7b1ae-ec67-4810-ae36-f0fa6624dc86 tempest-GroupsTest-1487486140 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-840579828 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-840579828, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:47:34 devstack cinder-volume[87571]: WARNING cinder.quota [None req-beb7b1ae-ec67-4810-ae36-f0fa6624dc86 tempest-GroupsTest-1487486140 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-840579828 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-840579828, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:47:34 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-beb7b1ae-ec67-4810-ae36-f0fa6624dc86 tempest-GroupsTest-1487486140 None] Created reservations ['b9758143-310e-45cf-b3d3-824560dd3c28', '2d988db8-f053-4882-a57d-cf9c39a3d6f6', 'e86232e4-833e-4843-bcdc-d3fd8ef7ac1a', 'c0e20ee5-813c-4239-90ac-f70b1b28c0cd'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:47:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-beb7b1ae-ec67-4810-ae36-f0fa6624dc86 tempest-GroupsTest-1487486140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-beb7b1ae-ec67-4810-ae36-f0fa6624dc86 tempest-GroupsTest-1487486140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-beb7b1ae-ec67-4810-ae36-f0fa6624dc86 tempest-GroupsTest-1487486140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-beb7b1ae-ec67-4810-ae36-f0fa6624dc86 tempest-GroupsTest-1487486140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-beb7b1ae-ec67-4810-ae36-f0fa6624dc86 tempest-GroupsTest-1487486140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-beb7b1ae-ec67-4810-ae36-f0fa6624dc86 tempest-GroupsTest-1487486140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:34 devstack sudo[92810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:47:34 devstack sudo[92810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:34 devstack sudo[92810]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-beb7b1ae-ec67-4810-ae36-f0fa6624dc86 tempest-GroupsTest-1487486140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.277s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:34 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-beb7b1ae-ec67-4810-ae36-f0fa6624dc86 tempest-GroupsTest-1487486140 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:47:34 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-beb7b1ae-ec67-4810-ae36-f0fa6624dc86 tempest-GroupsTest-1487486140 None] Delete group completed successfully. Sep 07 13:47:35 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-9c8e2078-771a-427f-80c6-6790fa6058a8 tempest-GroupsTest-1487486140 None] Created reservations ['34bfa590-b90d-4491-8525-f575a03c89dc'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:47:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9c8e2078-771a-427f-80c6-6790fa6058a8 tempest-GroupsTest-1487486140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9c8e2078-771a-427f-80c6-6790fa6058a8 tempest-GroupsTest-1487486140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:35 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9c8e2078-771a-427f-80c6-6790fa6058a8 tempest-GroupsTest-1487486140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:35 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9c8e2078-771a-427f-80c6-6790fa6058a8 tempest-GroupsTest-1487486140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9c8e2078-771a-427f-80c6-6790fa6058a8 tempest-GroupsTest-1487486140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9c8e2078-771a-427f-80c6-6790fa6058a8 tempest-GroupsTest-1487486140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:35 devstack sudo[92813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:47:35 devstack sudo[92813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:35 devstack sudo[92813]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9c8e2078-771a-427f-80c6-6790fa6058a8 tempest-GroupsTest-1487486140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.241s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:35 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-9c8e2078-771a-427f-80c6-6790fa6058a8 tempest-GroupsTest-1487486140 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:47:35 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-9c8e2078-771a-427f-80c6-6790fa6058a8 tempest-GroupsTest-1487486140 None] Delete group completed successfully. Sep 07 13:47:36 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:47:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Flow 'volume_create_manager' (5ffcc0ca-ec41-4c36-a696-309d4a6c0c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f39384b-5a10-47cc-8bd5-1d48390fd7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f39384b-5a10-47cc-8bd5-1d48390fd7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2145107098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2a58e7-40d9-4413-858d-b31ac02c1ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345242433a594208bb017b8fcfa98d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:36Z,use_quota=True,user_id='4807b37bb64a45fc9a80b1fe8d4d8fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c083c8b2-28f3-46f9-b268-0500683fe9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c083c8b2-28f3-46f9-b268-0500683fe9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c877c715-11cc-4397-af5a-fd494f4da65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c877c715-11cc-4397-af5a-fd494f4da65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b2a58e7-40d9-4413-858d-b31ac02c1ddb', 'volume_name': 'volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd055b03-9478-40f4-8d89-a8877eaedae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd055b03-9478-40f4-8d89-a8877eaedae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb330baf-bce9-4c65-9ca3-42f0df5861fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:36 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Volume 7b2a58e7-40d9-4413-858d-b31ac02c1ddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb', 'volume_size': 1} Sep 07 13:47:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2145107098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2a58e7-40d9-4413-858d-b31ac02c1ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345242433a594208bb017b8fcfa98d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:36Z,use_quota=True,user_id='4807b37bb64a45fc9a80b1fe8d4d8fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:47:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Creating volume 7b2a58e7-40d9-4413-858d-b31ac02c1ddb {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:47:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:47:36 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:47:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:36 devstack sudo[92818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb 1073741824 Sep 07 13:47:36 devstack sudo[92818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:36 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-ed540f52-8e08-4b19-b1cf-7e7236bc1e2f tempest-GroupsTest-1487486140 None] Group tempest-GroupsTest-Group-1087593773: creating Sep 07 13:47:37 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-ed540f52-8e08-4b19-b1cf-7e7236bc1e2f tempest-GroupsTest-1487486140 None] Group tempest-GroupsTest-Group-1087593773: created successfully Sep 07 13:47:37 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-ed540f52-8e08-4b19-b1cf-7e7236bc1e2f tempest-GroupsTest-1487486140 None] Create group completed successfully. Sep 07 13:47:37 devstack sudo[92818]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb 1073741824" returned: 0 in 0.629s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:37 devstack sudo[92828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb Sep 07 13:47:37 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:37 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb" returned: 0 in 0.333s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:37 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:47:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb330baf-bce9-4c65-9ca3-42f0df5861fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c54094-2232-4a99-81e9-37c2bf8a3098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:37 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Volume volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb (7b2a58e7-40d9-4413-858d-b31ac02c1ddb): created successfully Sep 07 13:47:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c54094-2232-4a99-81e9-37c2bf8a3098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Flow 'volume_create_manager' (5ffcc0ca-ec41-4c36-a696-309d4a6c0c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:37 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-0a89f488-1418-4f9f-86d4-d241e586c63f req-58445bbe-dfad-4d9c-a03f-dc554108a91c tempest-VolumesSnapshotsTestJSON-643463624 None] Created volume successfully. Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9d7313fd-9020-4327-9a36-28dbf4abbb98 tempest-BackendsCapabilitiesAdminTestsJSON-921002601 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5802955627441, 'free_capacity_gb': 1773.5802955627441, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87571) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-aa0effe9-7a1d-4079-8d0f-8ccd103512a0 tempest-BackendsCapabilitiesAdminTestsJSON-921002601 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5802955627441, 'free_capacity_gb': 1773.5802955627441, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87571) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Flow 'volume_create_manager' (29b93bae-090c-4318-9a38-cccc9d565677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f026a4-7ec4-4167-99d9-75638cdb880a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f026a4-7ec4-4167-99d9-75638cdb880a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-349861508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6cf53819-9009-428a-9a9a-6b7889462e4a,host='devstack@QuobyteHD#QuobyteHD',id=eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d42c308b091d4d3296d2c14a14ba0610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:39Z,use_quota=True,user_id='210712260fcc44829d7ce8ec31a29084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97820804-edc3-4ebc-bab0-5477e5285784),volume_type_id=97820804-edc3-4ebc-bab0-5477e5285784)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269d6081-8ef4-4e9f-8284-800b63f9b4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269d6081-8ef4-4e9f-8284-800b63f9b4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e84587-e689-431d-849d-d8a4a8ff1f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e84587-e689-431d-849d-d8a4a8ff1f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1', 'volume_name': 'volume-eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa219325-a555-42ba-b220-1f37338c61b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa219325-a555-42ba-b220-1f37338c61b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd64d6ae-2eeb-4a65-a84a-9456e0e818fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:38 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Volume eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1', 'volume_size': 1} Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6cf53819-9009-428a-9a9a-6b7889462e4a,created_at=2026-09-07T11:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-349861508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6cf53819-9009-428a-9a9a-6b7889462e4a,host='devstack@QuobyteHD#QuobyteHD',id=eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d42c308b091d4d3296d2c14a14ba0610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:39Z,use_quota=True,user_id='210712260fcc44829d7ce8ec31a29084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97820804-edc3-4ebc-bab0-5477e5285784),volume_type_id=97820804-edc3-4ebc-bab0-5477e5285784)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Creating volume eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:47:38 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:38 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1 1073741824 Sep 07 13:47:38 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-354815ea-2fe7-440e-ad24-6aab6779a1a3 req-f7d1c10d-61ca-4369-9ffd-32d92cd9b9d9 tempest-VolumesSnapshotsTestJSON-643463624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:39 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1 1073741824" returned: 0 in 0.534s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:39 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1 Sep 07 13:47:39 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:39 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1" returned: 0 in 0.288s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:47:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-354815ea-2fe7-440e-ad24-6aab6779a1a3 req-f7d1c10d-61ca-4369-9ffd-32d92cd9b9d9 tempest-VolumesSnapshotsTestJSON-643463624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.862s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd64d6ae-2eeb-4a65-a84a-9456e0e818fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97a2569-b082-4fd2-8a87-43ef4d852992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [req-354815ea-2fe7-440e-ad24-6aab6779a1a3 req-f7d1c10d-61ca-4369-9ffd-32d92cd9b9d9 tempest-VolumesSnapshotsTestJSON-643463624 None] Creating offline snapshot b5f4af13-8437-490a-984c-6416f723b615 of volume 7b2a58e7-40d9-4413-858d-b31ac02c1ddb {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:47:39 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Volume volume-eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1 (eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1): created successfully Sep 07 13:47:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97a2569-b082-4fd2-8a87-43ef4d852992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Flow 'volume_create_manager' (29b93bae-090c-4318-9a38-cccc9d565677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:39 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60de184-3813-4134-9c7a-2e48534e1c4c]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-354815ea-2fe7-440e-ad24-6aab6779a1a3 req-f7d1c10d-61ca-4369-9ffd-32d92cd9b9d9 tempest-VolumesSnapshotsTestJSON-643463624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:39 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-e7fa434d-3bfd-4676-b467-4ecd0294636a tempest-GroupsTest-1487486140 None] Created volume successfully. Sep 07 13:47:40 devstack sudo[92840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb Sep 07 13:47:40 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:40 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-354815ea-2fe7-440e-ad24-6aab6779a1a3 req-f7d1c10d-61ca-4369-9ffd-32d92cd9b9d9 tempest-VolumesSnapshotsTestJSON-643463624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb" returned: 0 in 0.359s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-354815ea-2fe7-440e-ad24-6aab6779a1a3 req-f7d1c10d-61ca-4369-9ffd-32d92cd9b9d9 tempest-VolumesSnapshotsTestJSON-643463624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.b5f4af13-8437-490a-984c-6416f723b615 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:40 devstack sudo[92845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.b5f4af13-8437-490a-984c-6416f723b615 1G Sep 07 13:47:40 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:40 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-354815ea-2fe7-440e-ad24-6aab6779a1a3 req-f7d1c10d-61ca-4369-9ffd-32d92cd9b9d9 tempest-VolumesSnapshotsTestJSON-643463624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.b5f4af13-8437-490a-984c-6416f723b615 1G" returned: 0 in 0.445s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-354815ea-2fe7-440e-ad24-6aab6779a1a3 req-f7d1c10d-61ca-4369-9ffd-32d92cd9b9d9 tempest-VolumesSnapshotsTestJSON-643463624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.b5f4af13-8437-490a-984c-6416f723b615 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:40 devstack sudo[92851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.b5f4af13-8437-490a-984c-6416f723b615 Sep 07 13:47:40 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:40 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-354815ea-2fe7-440e-ad24-6aab6779a1a3 req-f7d1c10d-61ca-4369-9ffd-32d92cd9b9d9 tempest-VolumesSnapshotsTestJSON-643463624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.b5f4af13-8437-490a-984c-6416f723b615" returned: 0 in 0.300s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:40 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [req-354815ea-2fe7-440e-ad24-6aab6779a1a3 req-f7d1c10d-61ca-4369-9ffd-32d92cd9b9d9 tempest-VolumesSnapshotsTestJSON-643463624 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.b5f4af13-8437-490a-984c-6416f723b615 is being set with open permissions: ugo+rw Sep 07 13:47:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-354815ea-2fe7-440e-ad24-6aab6779a1a3 req-f7d1c10d-61ca-4369-9ffd-32d92cd9b9d9 tempest-VolumesSnapshotsTestJSON-643463624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.b5f4af13-8437-490a-984c-6416f723b615 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:41 devstack sudo[92857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.b5f4af13-8437-490a-984c-6416f723b615 Sep 07 13:47:41 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:41 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-354815ea-2fe7-440e-ad24-6aab6779a1a3 req-f7d1c10d-61ca-4369-9ffd-32d92cd9b9d9 tempest-VolumesSnapshotsTestJSON-643463624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.b5f4af13-8437-490a-984c-6416f723b615" returned: 0 in 0.264s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-354815ea-2fe7-440e-ad24-6aab6779a1a3 req-f7d1c10d-61ca-4369-9ffd-32d92cd9b9d9 tempest-VolumesSnapshotsTestJSON-643463624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:41 devstack sudo[92860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.info Sep 07 13:47:41 devstack sudo[92860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:41 devstack sudo[92860]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-354815ea-2fe7-440e-ad24-6aab6779a1a3 req-f7d1c10d-61ca-4369-9ffd-32d92cd9b9d9 tempest-VolumesSnapshotsTestJSON-643463624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.info" returned: 0 in 0.324s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:41 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [req-354815ea-2fe7-440e-ad24-6aab6779a1a3 req-f7d1c10d-61ca-4369-9ffd-32d92cd9b9d9 tempest-VolumesSnapshotsTestJSON-643463624 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.info is being set with open permissions: ugo+rw Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-354815ea-2fe7-440e-ad24-6aab6779a1a3 req-f7d1c10d-61ca-4369-9ffd-32d92cd9b9d9 tempest-VolumesSnapshotsTestJSON-643463624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:41 devstack sudo[92863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.info Sep 07 13:47:41 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Flow 'volume_create_manager' (8a44d73e-7949-4ca7-a717-6a24682051d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d964df43-2a61-4e68-af7a-87970d28d92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d964df43-2a61-4e68-af7a-87970d28d92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1314523016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6cf53819-9009-428a-9a9a-6b7889462e4a,host='devstack@QuobyteHD#QuobyteHD',id=a05e9670-7494-4045-9093-31b29300960f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d42c308b091d4d3296d2c14a14ba0610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:42Z,use_quota=True,user_id='210712260fcc44829d7ce8ec31a29084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97820804-edc3-4ebc-bab0-5477e5285784),volume_type_id=97820804-edc3-4ebc-bab0-5477e5285784)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d01321a-53b6-4f40-9f45-c7b6a0596bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d01321a-53b6-4f40-9f45-c7b6a0596bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5115f262-d3ba-4099-9cca-01587ba698b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5115f262-d3ba-4099-9cca-01587ba698b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a05e9670-7494-4045-9093-31b29300960f', 'volume_name': 'volume-a05e9670-7494-4045-9093-31b29300960f', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949b7c29-a7d5-4a9c-89ad-5d8badbc6fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949b7c29-a7d5-4a9c-89ad-5d8badbc6fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0375559-70ac-4378-848c-a193cada63ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:41 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Volume a05e9670-7494-4045-9093-31b29300960f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a05e9670-7494-4045-9093-31b29300960f', 'volume_size': 1} Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:41 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-354815ea-2fe7-440e-ad24-6aab6779a1a3 req-f7d1c10d-61ca-4369-9ffd-32d92cd9b9d9 tempest-VolumesSnapshotsTestJSON-643463624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.info" returned: 0 in 0.272s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-354815ea-2fe7-440e-ad24-6aab6779a1a3 req-f7d1c10d-61ca-4369-9ffd-32d92cd9b9d9 tempest-VolumesSnapshotsTestJSON-643463624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.093s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.106s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6cf53819-9009-428a-9a9a-6b7889462e4a,created_at=2026-09-07T11:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1314523016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6cf53819-9009-428a-9a9a-6b7889462e4a,host='devstack@QuobyteHD#QuobyteHD',id=a05e9670-7494-4045-9093-31b29300960f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d42c308b091d4d3296d2c14a14ba0610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:42Z,use_quota=True,user_id='210712260fcc44829d7ce8ec31a29084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97820804-edc3-4ebc-bab0-5477e5285784),volume_type_id=97820804-edc3-4ebc-bab0-5477e5285784)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Creating volume a05e9670-7494-4045-9093-31b29300960f {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:47:41 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:47:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a05e9670-7494-4045-9093-31b29300960f 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:41 devstack sudo[92866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a05e9670-7494-4045-9093-31b29300960f 1073741824 Sep 07 13:47:41 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:41 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-354815ea-2fe7-440e-ad24-6aab6779a1a3 req-f7d1c10d-61ca-4369-9ffd-32d92cd9b9d9 tempest-VolumesSnapshotsTestJSON-643463624 None] Create snapshot completed successfully Sep 07 13:47:42 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a05e9670-7494-4045-9093-31b29300960f 1073741824" returned: 0 in 0.420s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a05e9670-7494-4045-9093-31b29300960f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:42 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a05e9670-7494-4045-9093-31b29300960f Sep 07 13:47:42 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:42 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a05e9670-7494-4045-9093-31b29300960f" returned: 0 in 0.264s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:42 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:47:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0375559-70ac-4378-848c-a193cada63ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a05e9670-7494-4045-9093-31b29300960f', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d79ae1-5f6e-4cac-8203-060820a3d388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-86dcdadf-daee-4317-9289-cda0674612cc req-2e29b998-038e-4e28-bb56-aad44f81bac7 tempest-VolumesSnapshotsTestJSON-643463624 None] Acquiring lock "cinder-b5f4af13-8437-490a-984c-6416f723b615-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:42 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Volume volume-a05e9670-7494-4045-9093-31b29300960f (a05e9670-7494-4045-9093-31b29300960f): created successfully Sep 07 13:47:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d79ae1-5f6e-4cac-8203-060820a3d388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Flow 'volume_create_manager' (8a44d73e-7949-4ca7-a717-6a24682051d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:42 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-805ad42d-8c54-4d07-a339-01cf3486fc49 tempest-GroupsTest-1487486140 None] Created volume successfully. Sep 07 13:47:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-86dcdadf-daee-4317-9289-cda0674612cc req-2e29b998-038e-4e28-bb56-aad44f81bac7 tempest-VolumesSnapshotsTestJSON-643463624 None] Lock "cinder-b5f4af13-8437-490a-984c-6416f723b615-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-86dcdadf-daee-4317-9289-cda0674612cc req-2e29b998-038e-4e28-bb56-aad44f81bac7 tempest-VolumesSnapshotsTestJSON-643463624 None] Acquiring lock "cinder-quobyte-7b2a58e7-40d9-4413-858d-b31ac02c1ddb" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-86dcdadf-daee-4317-9289-cda0674612cc req-2e29b998-038e-4e28-bb56-aad44f81bac7 tempest-VolumesSnapshotsTestJSON-643463624 None] Lock "cinder-quobyte-7b2a58e7-40d9-4413-858d-b31ac02c1ddb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-86dcdadf-daee-4317-9289-cda0674612cc req-2e29b998-038e-4e28-bb56-aad44f81bac7 tempest-VolumesSnapshotsTestJSON-643463624 None] Acquiring lock "cinder-quobyte-b5f4af13-8437-490a-984c-6416f723b615" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-86dcdadf-daee-4317-9289-cda0674612cc req-2e29b998-038e-4e28-bb56-aad44f81bac7 tempest-VolumesSnapshotsTestJSON-643463624 None] Lock "cinder-quobyte-b5f4af13-8437-490a-984c-6416f723b615" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:42 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [req-86dcdadf-daee-4317-9289-cda0674612cc req-2e29b998-038e-4e28-bb56-aad44f81bac7 tempest-VolumesSnapshotsTestJSON-643463624 None] Deleting offline snapshot b5f4af13-8437-490a-984c-6416f723b615 of volume 7b2a58e7-40d9-4413-858d-b31ac02c1ddb {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:47:42 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [req-86dcdadf-daee-4317-9289-cda0674612cc req-2e29b998-038e-4e28-bb56-aad44f81bac7 tempest-VolumesSnapshotsTestJSON-643463624 None] snapshot_file for this snap is: volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.b5f4af13-8437-490a-984c-6416f723b615 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:47:42 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71ea3de-f552-459c-a089-f2e2720e12eb]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-86dcdadf-daee-4317-9289-cda0674612cc req-2e29b998-038e-4e28-bb56-aad44f81bac7 tempest-VolumesSnapshotsTestJSON-643463624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.b5f4af13-8437-490a-984c-6416f723b615 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:42 devstack sudo[92875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.b5f4af13-8437-490a-984c-6416f723b615 Sep 07 13:47:42 devstack sudo[92875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:43 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-0df14673-6c4b-407a-ba02-f5c8a10129f1 tempest-GroupsTest-1487486140 None] Update group completed successfully. Sep 07 13:47:43 devstack sudo[92875]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-86dcdadf-daee-4317-9289-cda0674612cc req-2e29b998-038e-4e28-bb56-aad44f81bac7 tempest-VolumesSnapshotsTestJSON-643463624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.b5f4af13-8437-490a-984c-6416f723b615" returned: 0 in 0.390s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [req-86dcdadf-daee-4317-9289-cda0674612cc req-2e29b998-038e-4e28-bb56-aad44f81bac7 tempest-VolumesSnapshotsTestJSON-643463624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:47:43 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a9c2fb-4344-49da-946a-8483d1a9d75a]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-86dcdadf-daee-4317-9289-cda0674612cc req-2e29b998-038e-4e28-bb56-aad44f81bac7 tempest-VolumesSnapshotsTestJSON-643463624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:43 devstack sudo[92881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb Sep 07 13:47:43 devstack sudo[92881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:43 devstack sudo[92881]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-86dcdadf-daee-4317-9289-cda0674612cc req-2e29b998-038e-4e28-bb56-aad44f81bac7 tempest-VolumesSnapshotsTestJSON-643463624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb" returned: 0 in 0.355s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-86dcdadf-daee-4317-9289-cda0674612cc req-2e29b998-038e-4e28-bb56-aad44f81bac7 tempest-VolumesSnapshotsTestJSON-643463624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.b5f4af13-8437-490a-984c-6416f723b615 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:43 devstack sudo[92887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.b5f4af13-8437-490a-984c-6416f723b615 Sep 07 13:47:43 devstack sudo[92887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:43 devstack sudo[92887]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-86dcdadf-daee-4317-9289-cda0674612cc req-2e29b998-038e-4e28-bb56-aad44f81bac7 tempest-VolumesSnapshotsTestJSON-643463624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.b5f4af13-8437-490a-984c-6416f723b615" returned: 0 in 0.353s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-86dcdadf-daee-4317-9289-cda0674612cc req-2e29b998-038e-4e28-bb56-aad44f81bac7 tempest-VolumesSnapshotsTestJSON-643463624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.b5f4af13-8437-490a-984c-6416f723b615 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:43 devstack sudo[92894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.b5f4af13-8437-490a-984c-6416f723b615 Sep 07 13:47:43 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:44 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-86dcdadf-daee-4317-9289-cda0674612cc req-2e29b998-038e-4e28-bb56-aad44f81bac7 tempest-VolumesSnapshotsTestJSON-643463624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb.b5f4af13-8437-490a-984c-6416f723b615" returned: 0 in 0.282s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-86dcdadf-daee-4317-9289-cda0674612cc req-2e29b998-038e-4e28-bb56-aad44f81bac7 tempest-VolumesSnapshotsTestJSON-643463624 None] Lock "cinder-quobyte-b5f4af13-8437-490a-984c-6416f723b615" released by "_delete_snapshot" :: held 1.529s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-86dcdadf-daee-4317-9289-cda0674612cc req-2e29b998-038e-4e28-bb56-aad44f81bac7 tempest-VolumesSnapshotsTestJSON-643463624 None] Lock "cinder-quobyte-7b2a58e7-40d9-4413-858d-b31ac02c1ddb" released by "delete_snapshot" :: held 1.561s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:44 devstack cinder-volume[87571]: WARNING cinder.quota [req-86dcdadf-daee-4317-9289-cda0674612cc req-2e29b998-038e-4e28-bb56-aad44f81bac7 tempest-VolumesSnapshotsTestJSON-643463624 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:47:44 devstack cinder-volume[87571]: DEBUG cinder.quota [req-86dcdadf-daee-4317-9289-cda0674612cc req-2e29b998-038e-4e28-bb56-aad44f81bac7 tempest-VolumesSnapshotsTestJSON-643463624 None] Created reservations ['35d8190f-a455-4d13-af63-5e702002b054', '1b2c8614-c42b-4223-b163-c99e035e75bc', 'f08275d0-658c-40f3-9b9b-35799bcc8b3a', 'f60007b9-cafe-4c75-b8d2-78129240303e'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:47:44 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-86dcdadf-daee-4317-9289-cda0674612cc req-2e29b998-038e-4e28-bb56-aad44f81bac7 tempest-VolumesSnapshotsTestJSON-643463624 None] Delete snapshot completed successfully. Sep 07 13:47:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-86dcdadf-daee-4317-9289-cda0674612cc req-2e29b998-038e-4e28-bb56-aad44f81bac7 tempest-VolumesSnapshotsTestJSON-643463624 None] Lock "cinder-b5f4af13-8437-490a-984c-6416f723b615-delete_snapshot" released by "delete_snapshot" :: held 1.747s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:44 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c857bc6b-77ef-4d56-a821-e51bd841588d tempest-GroupsTest-1487486140 None] Update group completed successfully. Sep 07 13:47:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-59c30b9d-bb0b-4928-ba82-81e07ea15458 req-ae7a52e8-c7a8-4a19-8a08-239bb0a8cb8f tempest-VolumesSnapshotsTestJSON-643463624 None] Acquiring lock "cinder-7b2a58e7-40d9-4413-858d-b31ac02c1ddb-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-59c30b9d-bb0b-4928-ba82-81e07ea15458 req-ae7a52e8-c7a8-4a19-8a08-239bb0a8cb8f tempest-VolumesSnapshotsTestJSON-643463624 None] Lock "cinder-7b2a58e7-40d9-4413-858d-b31ac02c1ddb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:45 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-59c30b9d-bb0b-4928-ba82-81e07ea15458 req-ae7a52e8-c7a8-4a19-8a08-239bb0a8cb8f tempest-VolumesSnapshotsTestJSON-643463624 None] Acquiring lock "cinder-quobyte-7b2a58e7-40d9-4413-858d-b31ac02c1ddb" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:45 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-59c30b9d-bb0b-4928-ba82-81e07ea15458 req-ae7a52e8-c7a8-4a19-8a08-239bb0a8cb8f tempest-VolumesSnapshotsTestJSON-643463624 None] Lock "cinder-quobyte-7b2a58e7-40d9-4413-858d-b31ac02c1ddb" acquired by "delete_volume" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:45 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[890f81b9-1a45-4016-b0dd-bb44f17cf9e4]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-59c30b9d-bb0b-4928-ba82-81e07ea15458 req-ae7a52e8-c7a8-4a19-8a08-239bb0a8cb8f tempest-VolumesSnapshotsTestJSON-643463624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:45 devstack sudo[92902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb Sep 07 13:47:45 devstack sudo[92902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-151c5eac-a8b0-4ddb-aff1-a35c9ae2e33a req-b3d4c432-12ff-4896-be91-321ada272745 tempest-ServerActionsTestOtherA-611322616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-151c5eac-a8b0-4ddb-aff1-a35c9ae2e33a req-b3d4c432-12ff-4896-be91-321ada272745 tempest-ServerActionsTestOtherA-611322616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-151c5eac-a8b0-4ddb-aff1-a35c9ae2e33a req-b3d4c432-12ff-4896-be91-321ada272745 tempest-ServerActionsTestOtherA-611322616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:45 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-151c5eac-a8b0-4ddb-aff1-a35c9ae2e33a req-b3d4c432-12ff-4896-be91-321ada272745 tempest-ServerActionsTestOtherA-611322616 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285', 'name': 'volume-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0bbb76ec-fd17-4d7f-be03-5c9f05e85b6d', 'enforce_multipath': True} {{(pid=87571) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:47:45 devstack sudo[92902]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:45 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-151c5eac-a8b0-4ddb-aff1-a35c9ae2e33a req-b3d4c432-12ff-4896-be91-321ada272745 tempest-ServerActionsTestOtherA-611322616 None] attachment_update completed successfully. Sep 07 13:47:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-59c30b9d-bb0b-4928-ba82-81e07ea15458 req-ae7a52e8-c7a8-4a19-8a08-239bb0a8cb8f tempest-VolumesSnapshotsTestJSON-643463624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb" returned: 0 in 0.399s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-59c30b9d-bb0b-4928-ba82-81e07ea15458 req-ae7a52e8-c7a8-4a19-8a08-239bb0a8cb8f tempest-VolumesSnapshotsTestJSON-643463624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:45 devstack sudo[92915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb Sep 07 13:47:45 devstack sudo[92915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:45 devstack sudo[92915]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-59c30b9d-bb0b-4928-ba82-81e07ea15458 req-ae7a52e8-c7a8-4a19-8a08-239bb0a8cb8f tempest-VolumesSnapshotsTestJSON-643463624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7b2a58e7-40d9-4413-858d-b31ac02c1ddb" returned: 0 in 0.293s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:45 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-59c30b9d-bb0b-4928-ba82-81e07ea15458 req-ae7a52e8-c7a8-4a19-8a08-239bb0a8cb8f tempest-VolumesSnapshotsTestJSON-643463624 None] Lock "cinder-quobyte-7b2a58e7-40d9-4413-858d-b31ac02c1ddb" released by "delete_volume" :: held 0.782s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:45 devstack cinder-volume[87571]: DEBUG cinder.quota [req-59c30b9d-bb0b-4928-ba82-81e07ea15458 req-ae7a52e8-c7a8-4a19-8a08-239bb0a8cb8f tempest-VolumesSnapshotsTestJSON-643463624 None] Created reservations ['da25fe23-cc00-4c26-a488-7c121b442227', 'd77865ab-b2d0-4e6f-8ee4-b5bf0145ccd8', '89912cf9-f78a-4840-9a15-8bef2052bc4c', 'd6b0f3c5-c9d0-4f96-b15a-71b5b1994443'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:47:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-59c30b9d-bb0b-4928-ba82-81e07ea15458 req-ae7a52e8-c7a8-4a19-8a08-239bb0a8cb8f tempest-VolumesSnapshotsTestJSON-643463624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-59c30b9d-bb0b-4928-ba82-81e07ea15458 req-ae7a52e8-c7a8-4a19-8a08-239bb0a8cb8f tempest-VolumesSnapshotsTestJSON-643463624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:46 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [req-59c30b9d-bb0b-4928-ba82-81e07ea15458 req-ae7a52e8-c7a8-4a19-8a08-239bb0a8cb8f tempest-VolumesSnapshotsTestJSON-643463624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:46 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [req-59c30b9d-bb0b-4928-ba82-81e07ea15458 req-ae7a52e8-c7a8-4a19-8a08-239bb0a8cb8f tempest-VolumesSnapshotsTestJSON-643463624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-59c30b9d-bb0b-4928-ba82-81e07ea15458 req-ae7a52e8-c7a8-4a19-8a08-239bb0a8cb8f tempest-VolumesSnapshotsTestJSON-643463624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-59c30b9d-bb0b-4928-ba82-81e07ea15458 req-ae7a52e8-c7a8-4a19-8a08-239bb0a8cb8f tempest-VolumesSnapshotsTestJSON-643463624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:46 devstack sudo[93300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:47:46 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:46 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-59c30b9d-bb0b-4928-ba82-81e07ea15458 req-ae7a52e8-c7a8-4a19-8a08-239bb0a8cb8f tempest-VolumesSnapshotsTestJSON-643463624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.417s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:46 devstack cinder-volume[87571]: DEBUG cinder.manager [req-59c30b9d-bb0b-4928-ba82-81e07ea15458 req-ae7a52e8-c7a8-4a19-8a08-239bb0a8cb8f tempest-VolumesSnapshotsTestJSON-643463624 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:47:46 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-59c30b9d-bb0b-4928-ba82-81e07ea15458 req-ae7a52e8-c7a8-4a19-8a08-239bb0a8cb8f tempest-VolumesSnapshotsTestJSON-643463624 None] Deleted volume successfully. Sep 07 13:47:46 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-59c30b9d-bb0b-4928-ba82-81e07ea15458 req-ae7a52e8-c7a8-4a19-8a08-239bb0a8cb8f tempest-VolumesSnapshotsTestJSON-643463624 None] Lock "cinder-7b2a58e7-40d9-4413-858d-b31ac02c1ddb-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:46 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] Acquiring lock "cinder-quobyte-a05e9670-7494-4045-9093-31b29300960f" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:46 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] Lock "cinder-quobyte-a05e9670-7494-4045-9093-31b29300960f" acquired by "delete_volume" :: waited 0.036s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:46 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bf06e4-f18d-4a13-b9b1-062176d2e68e]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a05e9670-7494-4045-9093-31b29300960f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:46 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a05e9670-7494-4045-9093-31b29300960f Sep 07 13:47:46 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:47 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a05e9670-7494-4045-9093-31b29300960f" returned: 0 in 0.452s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a05e9670-7494-4045-9093-31b29300960f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:47 devstack sudo[93311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a05e9670-7494-4045-9093-31b29300960f Sep 07 13:47:47 devstack sudo[93311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:47 devstack sudo[93311]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a05e9670-7494-4045-9093-31b29300960f" returned: 0 in 0.303s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] Lock "cinder-quobyte-a05e9670-7494-4045-9093-31b29300960f" released by "delete_volume" :: held 0.831s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] Acquiring lock "cinder-quobyte-eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] Lock "cinder-quobyte-eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:47 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a848a36-85cf-4e72-94eb-67eb106db982]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:47 devstack sudo[93323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1 Sep 07 13:47:47 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:48 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1" returned: 0 in 0.590s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:48 devstack sudo[93334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1 Sep 07 13:47:48 devstack sudo[93334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:48 devstack sudo[93334]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1" returned: 0 in 0.309s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] Lock "cinder-quobyte-eaf28a5a-6f48-4ee4-bc1b-a6ae4d86dbf1" released by "delete_volume" :: held 0.983s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:48 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] Created reservations ['f789a0b1-b0e4-4ef8-84e2-242d99e54c98'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:47:48 devstack cinder-volume[87571]: WARNING cinder.quota [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1613085584 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1613085584, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:47:48 devstack cinder-volume[87571]: WARNING cinder.quota [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1613085584 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1613085584, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:47:48 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] Created reservations ['f75564f8-3a0e-4958-89e8-121b2d03308c', '010bcd80-3336-4e34-8aa3-db8e1c1f95fc', 'a3c2bcf8-2d0d-4a7d-a0fe-c97eacb8ceeb', 'd8190e0a-1528-4130-a69f-f8fae236bcb3'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:47:48 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] Created reservations ['1909ae1a-2af7-4f50-953e-3cb786b8e5ec', '98bd4d75-5dd5-4121-b16e-af828d4726c9', '9103289d-91c0-42ce-857d-4489cf879535', '0a6d40b4-af65-4592-b0cd-be0a903c5ec8'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:47:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:48 devstack sudo[93337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:47:48 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:49 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.277s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:49 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:47:49 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-74ef16f5-a30c-43c7-9b59-88566632da24 tempest-GroupsTest-1487486140 None] Delete group completed successfully. Sep 07 13:47:50 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-d9a186e7-17b7-401b-833d-fc4eff0215e4 req-cd39e325-03ed-4d9d-8918-ff0b737e6386 tempest-ServerActionsTestOtherA-611322616 None] Terminate volume connection completed successfully. Sep 07 13:47:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-d9a186e7-17b7-401b-833d-fc4eff0215e4 req-cd39e325-03ed-4d9d-8918-ff0b737e6386 tempest-ServerActionsTestOtherA-611322616 None] Deleting attachment 0bbb76ec-fd17-4d7f-be03-5c9f05e85b6d. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:47:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-d9a186e7-17b7-401b-833d-fc4eff0215e4 req-527c12a3-af5a-44f1-9fcb-5ef3350c288d tempest-ServerActionsTestOtherA-611322616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-d9a186e7-17b7-401b-833d-fc4eff0215e4 req-527c12a3-af5a-44f1-9fcb-5ef3350c288d tempest-ServerActionsTestOtherA-611322616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-d9a186e7-17b7-401b-833d-fc4eff0215e4 req-527c12a3-af5a-44f1-9fcb-5ef3350c288d tempest-ServerActionsTestOtherA-611322616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-d9a186e7-17b7-401b-833d-fc4eff0215e4 req-527c12a3-af5a-44f1-9fcb-5ef3350c288d tempest-ServerActionsTestOtherA-611322616 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285', 'name': 'volume-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '940c133d-7c8f-478e-9f9b-6988e55c4f34', 'enforce_multipath': True} {{(pid=87571) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:47:51 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-d9a186e7-17b7-401b-833d-fc4eff0215e4 req-527c12a3-af5a-44f1-9fcb-5ef3350c288d tempest-ServerActionsTestOtherA-611322616 None] attachment_update completed successfully. Sep 07 13:47:53 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-b3b70e99-df9a-4c09-9b4f-d364160698db tempest-GroupSnapshotsV319Test-809003811 None] Group tempest-GroupSnapshotsV319Test-Group-389492025: creating Sep 07 13:47:53 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-b3b70e99-df9a-4c09-9b4f-d364160698db tempest-GroupSnapshotsV319Test-809003811 None] Group tempest-GroupSnapshotsV319Test-Group-389492025: created successfully Sep 07 13:47:53 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-b3b70e99-df9a-4c09-9b4f-d364160698db tempest-GroupSnapshotsV319Test-809003811 None] Create group completed successfully. Sep 07 13:47:55 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:47:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Flow 'volume_create_manager' (a4c530da-beb5-4a6d-b75d-a235477a1d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ee102b-d9ba-40f7-861b-aadbae990ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ee102b-d9ba-40f7-861b-aadbae990ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1758743165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=666b9b49-6baf-4ef0-9e77-b0631c55498e,host='devstack@QuobyteHD#QuobyteHD',id=d0a2c806-fb2e-45d8-986c-b271b955525e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390cde491dd243119eb2e660145a2934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:56Z,use_quota=True,user_id='ed66a4911cb54fea85cde44c238d377b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2cb8cbf9-9e31-4120-a342-819d2258bc3d),volume_type_id=2cb8cbf9-9e31-4120-a342-819d2258bc3d)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f114d681-e72b-416f-a324-103a01a83121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f114d681-e72b-416f-a324-103a01a83121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d91b82df-f1ef-4ec1-97fe-3aa9123b7022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d91b82df-f1ef-4ec1-97fe-3aa9123b7022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0a2c806-fb2e-45d8-986c-b271b955525e', 'volume_name': 'volume-d0a2c806-fb2e-45d8-986c-b271b955525e', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e2c3b9-d0d4-4791-97ec-a983ef03b289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e2c3b9-d0d4-4791-97ec-a983ef03b289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52a1391-866f-4431-a947-3e726f1b4ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:55 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Volume d0a2c806-fb2e-45d8-986c-b271b955525e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0a2c806-fb2e-45d8-986c-b271b955525e', 'volume_size': 1} Sep 07 13:47:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=666b9b49-6baf-4ef0-9e77-b0631c55498e,created_at=2026-09-07T11:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1758743165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=666b9b49-6baf-4ef0-9e77-b0631c55498e,host='devstack@QuobyteHD#QuobyteHD',id=d0a2c806-fb2e-45d8-986c-b271b955525e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390cde491dd243119eb2e660145a2934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:56Z,use_quota=True,user_id='ed66a4911cb54fea85cde44c238d377b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2cb8cbf9-9e31-4120-a342-819d2258bc3d),volume_type_id=2cb8cbf9-9e31-4120-a342-819d2258bc3d)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:47:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Creating volume d0a2c806-fb2e-45d8-986c-b271b955525e {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:47:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:47:55 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:47:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:56 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e 1073741824 Sep 07 13:47:56 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:56 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e 1073741824" returned: 0 in 0.577s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:56 devstack sudo[93847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e Sep 07 13:47:56 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:56 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e" returned: 0 in 0.296s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:47:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52a1391-866f-4431-a947-3e726f1b4ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0a2c806-fb2e-45d8-986c-b271b955525e', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f9ed81-b0b9-48b4-95d4-8d2795645ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:56 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Volume volume-d0a2c806-fb2e-45d8-986c-b271b955525e (d0a2c806-fb2e-45d8-986c-b271b955525e): created successfully Sep 07 13:47:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f9ed81-b0b9-48b4-95d4-8d2795645ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Flow 'volume_create_manager' (a4c530da-beb5-4a6d-b75d-a235477a1d47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:57 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-27b1a6b0-4071-428c-8db0-a116f0cb9820 tempest-GroupSnapshotsV319Test-809003811 None] Created volume successfully. Sep 07 13:47:58 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-6426d152-a35d-48be-94ac-e6cb5a2300eb tempest-GroupSnapshotsV319Test-809003811 None] GroupSnapshot d7ac20d4-3569-4cbb-8274-e9a7c26ce2f5: creating. Sep 07 13:47:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-6426d152-a35d-48be-94ac-e6cb5a2300eb tempest-GroupSnapshotsV319Test-809003811 None] Group snapshot d7ac20d4-3569-4cbb-8274-e9a7c26ce2f5: creating. {{(pid=87571) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 13:47:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6426d152-a35d-48be-94ac-e6cb5a2300eb tempest-GroupSnapshotsV319Test-809003811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6426d152-a35d-48be-94ac-e6cb5a2300eb tempest-GroupSnapshotsV319Test-809003811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-6426d152-a35d-48be-94ac-e6cb5a2300eb tempest-GroupSnapshotsV319Test-809003811 None] Creating offline snapshot 38b61f93-2208-49da-b090-e6252041a567 of volume d0a2c806-fb2e-45d8-986c-b271b955525e {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:47:58 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba277f1-d86f-4e52-a2c8-69f0b247b8c0]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6426d152-a35d-48be-94ac-e6cb5a2300eb tempest-GroupSnapshotsV319Test-809003811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:58 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e Sep 07 13:47:58 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:59 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-9e96a931-9ac2-49f4-9bd5-9ef8090d4d35 tempest-GroupsV320Test-1842640078 None] Group tempest-GroupsV320Test-Group-1923663966: creating Sep 07 13:47:59 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-9e96a931-9ac2-49f4-9bd5-9ef8090d4d35 tempest-GroupsV320Test-1842640078 None] Group tempest-GroupsV320Test-Group-1923663966: created successfully Sep 07 13:47:59 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-9e96a931-9ac2-49f4-9bd5-9ef8090d4d35 tempest-GroupsV320Test-1842640078 None] Create group completed successfully. Sep 07 13:47:59 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6426d152-a35d-48be-94ac-e6cb5a2300eb tempest-GroupSnapshotsV319Test-809003811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e" returned: 0 in 0.502s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6426d152-a35d-48be-94ac-e6cb5a2300eb tempest-GroupSnapshotsV319Test-809003811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.38b61f93-2208-49da-b090-e6252041a567 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:59 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.38b61f93-2208-49da-b090-e6252041a567 1G Sep 07 13:47:59 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:59 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6426d152-a35d-48be-94ac-e6cb5a2300eb tempest-GroupSnapshotsV319Test-809003811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.38b61f93-2208-49da-b090-e6252041a567 1G" returned: 0 in 0.501s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6426d152-a35d-48be-94ac-e6cb5a2300eb tempest-GroupSnapshotsV319Test-809003811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0a2c806-fb2e-45d8-986c-b271b955525e -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.38b61f93-2208-49da-b090-e6252041a567 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:59 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0a2c806-fb2e-45d8-986c-b271b955525e -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.38b61f93-2208-49da-b090-e6252041a567 Sep 07 13:47:59 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:00 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6426d152-a35d-48be-94ac-e6cb5a2300eb tempest-GroupSnapshotsV319Test-809003811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0a2c806-fb2e-45d8-986c-b271b955525e -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.38b61f93-2208-49da-b090-e6252041a567" returned: 0 in 0.327s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:00 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-6426d152-a35d-48be-94ac-e6cb5a2300eb tempest-GroupSnapshotsV319Test-809003811 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.38b61f93-2208-49da-b090-e6252041a567 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:48:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6426d152-a35d-48be-94ac-e6cb5a2300eb tempest-GroupSnapshotsV319Test-809003811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.38b61f93-2208-49da-b090-e6252041a567 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:00 devstack sudo[93869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.38b61f93-2208-49da-b090-e6252041a567 Sep 07 13:48:00 devstack sudo[93869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:00 devstack sudo[93869]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6426d152-a35d-48be-94ac-e6cb5a2300eb tempest-GroupSnapshotsV319Test-809003811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.38b61f93-2208-49da-b090-e6252041a567" returned: 0 in 0.294s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6426d152-a35d-48be-94ac-e6cb5a2300eb tempest-GroupSnapshotsV319Test-809003811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:00 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.info Sep 07 13:48:00 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:00 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6426d152-a35d-48be-94ac-e6cb5a2300eb tempest-GroupSnapshotsV319Test-809003811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.info" returned: 0 in 0.318s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:00 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-6426d152-a35d-48be-94ac-e6cb5a2300eb tempest-GroupSnapshotsV319Test-809003811 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:48:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6426d152-a35d-48be-94ac-e6cb5a2300eb tempest-GroupSnapshotsV319Test-809003811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:00 devstack sudo[93875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.info Sep 07 13:48:00 devstack sudo[93875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:01 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-8d0b9f6c-7cbb-41a5-82ff-d62f6e270d3b tempest-GroupsV320Test-1842640078 None] Created reservations ['dc3c640a-c2cb-4859-809d-3eb5e9cb5602'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:01 devstack sudo[93875]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8d0b9f6c-7cbb-41a5-82ff-d62f6e270d3b tempest-GroupsV320Test-1842640078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8d0b9f6c-7cbb-41a5-82ff-d62f6e270d3b tempest-GroupsV320Test-1842640078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8d0b9f6c-7cbb-41a5-82ff-d62f6e270d3b tempest-GroupsV320Test-1842640078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8d0b9f6c-7cbb-41a5-82ff-d62f6e270d3b tempest-GroupsV320Test-1842640078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8d0b9f6c-7cbb-41a5-82ff-d62f6e270d3b tempest-GroupsV320Test-1842640078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8d0b9f6c-7cbb-41a5-82ff-d62f6e270d3b tempest-GroupsV320Test-1842640078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6426d152-a35d-48be-94ac-e6cb5a2300eb tempest-GroupSnapshotsV319Test-809003811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.info" returned: 0 in 0.381s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:01 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:48:01 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6426d152-a35d-48be-94ac-e6cb5a2300eb tempest-GroupSnapshotsV319Test-809003811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.445s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:01 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-6426d152-a35d-48be-94ac-e6cb5a2300eb tempest-GroupSnapshotsV319Test-809003811 None] group_snapshot d7ac20d4-3569-4cbb-8274-e9a7c26ce2f5: created successfully Sep 07 13:48:01 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8d0b9f6c-7cbb-41a5-82ff-d62f6e270d3b tempest-GroupsV320Test-1842640078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.292s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:01 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-8d0b9f6c-7cbb-41a5-82ff-d62f6e270d3b tempest-GroupsV320Test-1842640078 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:48:01 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-8d0b9f6c-7cbb-41a5-82ff-d62f6e270d3b tempest-GroupsV320Test-1842640078 None] Delete group completed successfully. Sep 07 13:48:02 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-6f60903b-ef56-4ba7-b84c-9134069d1fe0 tempest-GroupSnapshotsV319Test-809003811 None] group_snapshot d7ac20d4-3569-4cbb-8274-e9a7c26ce2f5: deleting Sep 07 13:48:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-6f60903b-ef56-4ba7-b84c-9134069d1fe0 tempest-GroupSnapshotsV319Test-809003811 None] group_snapshot d7ac20d4-3569-4cbb-8274-e9a7c26ce2f5: deleting {{(pid=87571) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 13:48:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6f60903b-ef56-4ba7-b84c-9134069d1fe0 tempest-GroupSnapshotsV319Test-809003811 None] Acquiring lock "cinder-quobyte-d0a2c806-fb2e-45d8-986c-b271b955525e" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6f60903b-ef56-4ba7-b84c-9134069d1fe0 tempest-GroupSnapshotsV319Test-809003811 None] Lock "cinder-quobyte-d0a2c806-fb2e-45d8-986c-b271b955525e" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6f60903b-ef56-4ba7-b84c-9134069d1fe0 tempest-GroupSnapshotsV319Test-809003811 None] Acquiring lock "cinder-quobyte-38b61f93-2208-49da-b090-e6252041a567" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6f60903b-ef56-4ba7-b84c-9134069d1fe0 tempest-GroupSnapshotsV319Test-809003811 None] Lock "cinder-quobyte-38b61f93-2208-49da-b090-e6252041a567" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-6f60903b-ef56-4ba7-b84c-9134069d1fe0 tempest-GroupSnapshotsV319Test-809003811 None] Deleting offline snapshot 38b61f93-2208-49da-b090-e6252041a567 of volume d0a2c806-fb2e-45d8-986c-b271b955525e {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:48:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-6f60903b-ef56-4ba7-b84c-9134069d1fe0 tempest-GroupSnapshotsV319Test-809003811 None] snapshot_file for this snap is: volume-d0a2c806-fb2e-45d8-986c-b271b955525e.38b61f93-2208-49da-b090-e6252041a567 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:48:02 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b932a1f1-61eb-4292-8e53-cbd06a81a665]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6f60903b-ef56-4ba7-b84c-9134069d1fe0 tempest-GroupSnapshotsV319Test-809003811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.38b61f93-2208-49da-b090-e6252041a567 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:02 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.38b61f93-2208-49da-b090-e6252041a567 Sep 07 13:48:02 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:03 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6f60903b-ef56-4ba7-b84c-9134069d1fe0 tempest-GroupSnapshotsV319Test-809003811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.38b61f93-2208-49da-b090-e6252041a567" returned: 0 in 0.479s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:03 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-6f60903b-ef56-4ba7-b84c-9134069d1fe0 tempest-GroupSnapshotsV319Test-809003811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0a2c806-fb2e-45d8-986c-b271b955525e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:48:03 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e7185b-17b6-4d83-b7df-76621281cc68]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6f60903b-ef56-4ba7-b84c-9134069d1fe0 tempest-GroupSnapshotsV319Test-809003811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:03 devstack sudo[93923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e Sep 07 13:48:03 devstack sudo[93923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:03 devstack sudo[93923]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6f60903b-ef56-4ba7-b84c-9134069d1fe0 tempest-GroupSnapshotsV319Test-809003811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e" returned: 0 in 0.448s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6f60903b-ef56-4ba7-b84c-9134069d1fe0 tempest-GroupSnapshotsV319Test-809003811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.38b61f93-2208-49da-b090-e6252041a567 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:03 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.38b61f93-2208-49da-b090-e6252041a567 Sep 07 13:48:03 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:04 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6f60903b-ef56-4ba7-b84c-9134069d1fe0 tempest-GroupSnapshotsV319Test-809003811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.38b61f93-2208-49da-b090-e6252041a567" returned: 0 in 0.514s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6f60903b-ef56-4ba7-b84c-9134069d1fe0 tempest-GroupSnapshotsV319Test-809003811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.38b61f93-2208-49da-b090-e6252041a567 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:04 devstack sudo[93934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.38b61f93-2208-49da-b090-e6252041a567 Sep 07 13:48:04 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:04 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6f60903b-ef56-4ba7-b84c-9134069d1fe0 tempest-GroupSnapshotsV319Test-809003811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e.38b61f93-2208-49da-b090-e6252041a567" returned: 0 in 0.346s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Flow 'volume_create_manager' (bd06da8a-150e-4a8c-83fc-b9c5b0be5137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3d0328-3d0f-4c68-bc59-71206f137451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6f60903b-ef56-4ba7-b84c-9134069d1fe0 tempest-GroupSnapshotsV319Test-809003811 None] Lock "cinder-quobyte-38b61f93-2208-49da-b090-e6252041a567" released by "_delete_snapshot" :: held 1.975s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3d0328-3d0f-4c68-bc59-71206f137451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1488948666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf008b09-3bb5-4b9e-be93-5343cb4b690e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ff6324368148df92e8566939a9276e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:48:04Z,use_quota=True,user_id='f5e672632e3c4de1ba52ebfe37d8d2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22410ff5-16bb-42e4-a08e-04722d59ead9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22410ff5-16bb-42e4-a08e-04722d59ead9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af212fa4-9ebc-4d31-9890-b3796aca27c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af212fa4-9ebc-4d31-9890-b3796aca27c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf008b09-3bb5-4b9e-be93-5343cb4b690e', 'volume_name': 'volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec02d56d-0aaa-413f-923f-5564ec3dc97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec02d56d-0aaa-413f-923f-5564ec3dc97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30754ffd-2bac-434b-a362-9501de4d9f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:04 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Volume bf008b09-3bb5-4b9e-be93-5343cb4b690e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e', 'volume_size': 1} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1488948666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf008b09-3bb5-4b9e-be93-5343cb4b690e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ff6324368148df92e8566939a9276e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:48:04Z,use_quota=True,user_id='f5e672632e3c4de1ba52ebfe37d8d2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Creating volume bf008b09-3bb5-4b9e-be93-5343cb4b690e {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:48:04 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6f60903b-ef56-4ba7-b84c-9134069d1fe0 tempest-GroupSnapshotsV319Test-809003811 None] Lock "cinder-quobyte-d0a2c806-fb2e-45d8-986c-b271b955525e" released by "delete_snapshot" :: held 2.099s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:04 devstack sudo[93937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e 1073741824 Sep 07 13:48:04 devstack sudo[93937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:04 devstack cinder-volume[87571]: WARNING cinder.quota [None req-6f60903b-ef56-4ba7-b84c-9134069d1fe0 tempest-GroupSnapshotsV319Test-809003811 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1442728579 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1442728579, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:48:04 devstack cinder-volume[87571]: WARNING cinder.quota [None req-6f60903b-ef56-4ba7-b84c-9134069d1fe0 tempest-GroupSnapshotsV319Test-809003811 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1442728579 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1442728579, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:48:04 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-6f60903b-ef56-4ba7-b84c-9134069d1fe0 tempest-GroupSnapshotsV319Test-809003811 None] Created reservations ['04c54464-0260-4290-b0a3-dc80567b3e74', 'af8e8fe9-7cb5-4c86-b4f0-1102f0586258', '3525c3ce-18bc-477a-aa4a-f2832001832b', '9661f794-f7d6-4838-824d-f46db27087b0'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:04 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-6f60903b-ef56-4ba7-b84c-9134069d1fe0 tempest-GroupSnapshotsV319Test-809003811 None] group_snapshot d7ac20d4-3569-4cbb-8274-e9a7c26ce2f5: deleted successfully Sep 07 13:48:05 devstack sudo[93937]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e 1073741824" returned: 0 in 0.595s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-26a76e26-f921-4a9f-bdf3-6f5a367cb982 tempest-GroupSnapshotsV319Test-809003811 None] Acquiring lock "cinder-quobyte-d0a2c806-fb2e-45d8-986c-b271b955525e" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-26a76e26-f921-4a9f-bdf3-6f5a367cb982 tempest-GroupSnapshotsV319Test-809003811 None] Lock "cinder-quobyte-d0a2c806-fb2e-45d8-986c-b271b955525e" acquired by "delete_volume" :: waited 0.051s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:05 devstack sudo[93943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e Sep 07 13:48:05 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:05 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e55d83-66d0-4eb9-a288-7fac643ed835]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-26a76e26-f921-4a9f-bdf3-6f5a367cb982 tempest-GroupSnapshotsV319Test-809003811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:05 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e Sep 07 13:48:05 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:05 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e" returned: 0 in 0.345s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:48:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30754ffd-2bac-434b-a362-9501de4d9f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece45d96-113e-4330-8873-4988d6da469e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:05 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Volume volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e (bf008b09-3bb5-4b9e-be93-5343cb4b690e): created successfully Sep 07 13:48:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece45d96-113e-4330-8873-4988d6da469e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Flow 'volume_create_manager' (bd06da8a-150e-4a8c-83fc-b9c5b0be5137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:48:05 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-1543d1e4-19ac-49a6-b515-dc975bf7e094 tempest-SnapshotsActionsTest-1280823395 None] Created volume successfully. Sep 07 13:48:05 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-26a76e26-f921-4a9f-bdf3-6f5a367cb982 tempest-GroupSnapshotsV319Test-809003811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e" returned: 0 in 0.531s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-26a76e26-f921-4a9f-bdf3-6f5a367cb982 tempest-GroupSnapshotsV319Test-809003811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:05 devstack sudo[93951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e Sep 07 13:48:05 devstack sudo[93951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:06 devstack sudo[93951]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-26a76e26-f921-4a9f-bdf3-6f5a367cb982 tempest-GroupSnapshotsV319Test-809003811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d0a2c806-fb2e-45d8-986c-b271b955525e" returned: 0 in 0.257s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:06 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-26a76e26-f921-4a9f-bdf3-6f5a367cb982 tempest-GroupSnapshotsV319Test-809003811 None] Lock "cinder-quobyte-d0a2c806-fb2e-45d8-986c-b271b955525e" released by "delete_volume" :: held 0.861s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:06 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-26a76e26-f921-4a9f-bdf3-6f5a367cb982 tempest-GroupSnapshotsV319Test-809003811 None] Created reservations ['6917a17a-9ad9-4aa2-9374-527a6f599d1f'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:06 devstack cinder-volume[87571]: WARNING cinder.quota [None req-26a76e26-f921-4a9f-bdf3-6f5a367cb982 tempest-GroupSnapshotsV319Test-809003811 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1442728579 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1442728579, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:48:06 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-26a76e26-f921-4a9f-bdf3-6f5a367cb982 tempest-GroupSnapshotsV319Test-809003811 None] Created reservations ['d848e3a3-dc66-4560-a6b9-76217dde054f', 'e75ca2cd-6a2f-4069-9afa-1f46728008df', 'cd0128ec-7523-450f-b422-b96d09efd686', 'af1b95d4-6e3f-4eab-807a-1010f89a5fb8'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-26a76e26-f921-4a9f-bdf3-6f5a367cb982 tempest-GroupSnapshotsV319Test-809003811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-26a76e26-f921-4a9f-bdf3-6f5a367cb982 tempest-GroupSnapshotsV319Test-809003811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-26a76e26-f921-4a9f-bdf3-6f5a367cb982 tempest-GroupSnapshotsV319Test-809003811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-26a76e26-f921-4a9f-bdf3-6f5a367cb982 tempest-GroupSnapshotsV319Test-809003811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-26a76e26-f921-4a9f-bdf3-6f5a367cb982 tempest-GroupSnapshotsV319Test-809003811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-26a76e26-f921-4a9f-bdf3-6f5a367cb982 tempest-GroupSnapshotsV319Test-809003811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:06 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:48:06 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:06 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-26a76e26-f921-4a9f-bdf3-6f5a367cb982 tempest-GroupSnapshotsV319Test-809003811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.312s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:06 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-26a76e26-f921-4a9f-bdf3-6f5a367cb982 tempest-GroupSnapshotsV319Test-809003811 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:48:06 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-26a76e26-f921-4a9f-bdf3-6f5a367cb982 tempest-GroupSnapshotsV319Test-809003811 None] Delete group completed successfully. Sep 07 13:48:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d4cf0532-db3d-47ac-aee4-98c107156335 tempest-SnapshotsActionsTest-1280823395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d4cf0532-db3d-47ac-aee4-98c107156335 tempest-SnapshotsActionsTest-1280823395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-d4cf0532-db3d-47ac-aee4-98c107156335 tempest-SnapshotsActionsTest-1280823395 None] Creating offline snapshot 7b364960-9335-4cd2-817a-1173dc3c909d of volume bf008b09-3bb5-4b9e-be93-5343cb4b690e {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:48:06 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dece5c3-2908-4c46-8d54-2ee2be11cc1d]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d4cf0532-db3d-47ac-aee4-98c107156335 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:07 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e Sep 07 13:48:07 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:07 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d4cf0532-db3d-47ac-aee4-98c107156335 tempest-SnapshotsActionsTest-1280823395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e" returned: 0 in 0.489s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d4cf0532-db3d-47ac-aee4-98c107156335 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:07 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d 1G Sep 07 13:48:07 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:07 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d4cf0532-db3d-47ac-aee4-98c107156335 tempest-SnapshotsActionsTest-1280823395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d 1G" returned: 0 in 0.524s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d4cf0532-db3d-47ac-aee4-98c107156335 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:08 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d Sep 07 13:48:08 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:08 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d4cf0532-db3d-47ac-aee4-98c107156335 tempest-SnapshotsActionsTest-1280823395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d" returned: 0 in 0.387s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:08 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-d4cf0532-db3d-47ac-aee4-98c107156335 tempest-SnapshotsActionsTest-1280823395 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d is being set with open permissions: ugo+rw Sep 07 13:48:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d4cf0532-db3d-47ac-aee4-98c107156335 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:08 devstack sudo[94012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d Sep 07 13:48:08 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:08 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d4cf0532-db3d-47ac-aee4-98c107156335 tempest-SnapshotsActionsTest-1280823395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d" returned: 0 in 0.334s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d4cf0532-db3d-47ac-aee4-98c107156335 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:08 devstack sudo[94015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.info Sep 07 13:48:08 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:09 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d4cf0532-db3d-47ac-aee4-98c107156335 tempest-SnapshotsActionsTest-1280823395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.info" returned: 0 in 0.304s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:09 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-d4cf0532-db3d-47ac-aee4-98c107156335 tempest-SnapshotsActionsTest-1280823395 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.info is being set with open permissions: ugo+rw Sep 07 13:48:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d4cf0532-db3d-47ac-aee4-98c107156335 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:09 devstack sudo[94018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.info Sep 07 13:48:09 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:09 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d4cf0532-db3d-47ac-aee4-98c107156335 tempest-SnapshotsActionsTest-1280823395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.info" returned: 0 in 0.255s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d4cf0532-db3d-47ac-aee4-98c107156335 tempest-SnapshotsActionsTest-1280823395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.417s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:09 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-d4cf0532-db3d-47ac-aee4-98c107156335 tempest-SnapshotsActionsTest-1280823395 None] Create snapshot completed successfully Sep 07 13:48:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ac228885-9d3b-47fc-9684-f61434960df3 tempest-SnapshotsActionsTest-1280823395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ac228885-9d3b-47fc-9684-f61434960df3 tempest-SnapshotsActionsTest-1280823395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-ac228885-9d3b-47fc-9684-f61434960df3 tempest-SnapshotsActionsTest-1280823395 None] Creating offline snapshot 1ccd838d-555b-48f6-aa06-6aaf06e5b7d3 of volume bf008b09-3bb5-4b9e-be93-5343cb4b690e {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:48:10 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e033c66d-0f28-4b34-985c-c3d9bc70cc86]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ac228885-9d3b-47fc-9684-f61434960df3 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:11 devstack sudo[94021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d Sep 07 13:48:11 devstack sudo[94021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:11 devstack sudo[94021]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ac228885-9d3b-47fc-9684-f61434960df3 tempest-SnapshotsActionsTest-1280823395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d" returned: 0 in 0.397s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:11 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-ac228885-9d3b-47fc-9684-f61434960df3 tempest-SnapshotsActionsTest-1280823395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:48:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ac228885-9d3b-47fc-9684-f61434960df3 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.1ccd838d-555b-48f6-aa06-6aaf06e5b7d3 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:11 devstack sudo[94026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.1ccd838d-555b-48f6-aa06-6aaf06e5b7d3 1G Sep 07 13:48:11 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:11 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ac228885-9d3b-47fc-9684-f61434960df3 tempest-SnapshotsActionsTest-1280823395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.1ccd838d-555b-48f6-aa06-6aaf06e5b7d3 1G" returned: 0 in 0.494s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ac228885-9d3b-47fc-9684-f61434960df3 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.1ccd838d-555b-48f6-aa06-6aaf06e5b7d3 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:11 devstack sudo[94033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.1ccd838d-555b-48f6-aa06-6aaf06e5b7d3 Sep 07 13:48:11 devstack sudo[94033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:12 devstack sudo[94033]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ac228885-9d3b-47fc-9684-f61434960df3 tempest-SnapshotsActionsTest-1280823395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.1ccd838d-555b-48f6-aa06-6aaf06e5b7d3" returned: 0 in 0.308s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:12 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-ac228885-9d3b-47fc-9684-f61434960df3 tempest-SnapshotsActionsTest-1280823395 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.1ccd838d-555b-48f6-aa06-6aaf06e5b7d3 is being set with open permissions: ugo+rw Sep 07 13:48:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ac228885-9d3b-47fc-9684-f61434960df3 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.1ccd838d-555b-48f6-aa06-6aaf06e5b7d3 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:12 devstack sudo[94039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.1ccd838d-555b-48f6-aa06-6aaf06e5b7d3 Sep 07 13:48:12 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:12 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ac228885-9d3b-47fc-9684-f61434960df3 tempest-SnapshotsActionsTest-1280823395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.1ccd838d-555b-48f6-aa06-6aaf06e5b7d3" returned: 0 in 0.252s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ac228885-9d3b-47fc-9684-f61434960df3 tempest-SnapshotsActionsTest-1280823395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.572s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:12 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-ac228885-9d3b-47fc-9684-f61434960df3 tempest-SnapshotsActionsTest-1280823395 None] Create snapshot completed successfully Sep 07 13:48:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-81b643f9-f4ae-465a-ab1a-f7502f30e498 tempest-SnapshotsActionsTest-1829708489 None] Acquiring lock "cinder-1ccd838d-555b-48f6-aa06-6aaf06e5b7d3-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-81b643f9-f4ae-465a-ab1a-f7502f30e498 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-1ccd838d-555b-48f6-aa06-6aaf06e5b7d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-81b643f9-f4ae-465a-ab1a-f7502f30e498 tempest-SnapshotsActionsTest-1829708489 None] Acquiring lock "cinder-quobyte-bf008b09-3bb5-4b9e-be93-5343cb4b690e" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-81b643f9-f4ae-465a-ab1a-f7502f30e498 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-quobyte-bf008b09-3bb5-4b9e-be93-5343cb4b690e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-81b643f9-f4ae-465a-ab1a-f7502f30e498 tempest-SnapshotsActionsTest-1829708489 None] Acquiring lock "cinder-quobyte-1ccd838d-555b-48f6-aa06-6aaf06e5b7d3" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-81b643f9-f4ae-465a-ab1a-f7502f30e498 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-quobyte-1ccd838d-555b-48f6-aa06-6aaf06e5b7d3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:13 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-81b643f9-f4ae-465a-ab1a-f7502f30e498 tempest-SnapshotsActionsTest-1829708489 None] Deleting offline snapshot 1ccd838d-555b-48f6-aa06-6aaf06e5b7d3 of volume bf008b09-3bb5-4b9e-be93-5343cb4b690e {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:48:13 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-81b643f9-f4ae-465a-ab1a-f7502f30e498 tempest-SnapshotsActionsTest-1829708489 None] snapshot_file for this snap is: volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.1ccd838d-555b-48f6-aa06-6aaf06e5b7d3 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:48:13 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d3e2a2-8cf6-4ee0-b6d9-c94c3ef7ca89]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-81b643f9-f4ae-465a-ab1a-f7502f30e498 tempest-SnapshotsActionsTest-1829708489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.1ccd838d-555b-48f6-aa06-6aaf06e5b7d3 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:13 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.1ccd838d-555b-48f6-aa06-6aaf06e5b7d3 Sep 07 13:48:13 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:13 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c5e5ce1f-6a53-4667-89d4-864956de0902 tempest-GroupsV314Test-2113742378 None] Group tempest-GroupsV314Test-Group-1399995813: creating Sep 07 13:48:13 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c5e5ce1f-6a53-4667-89d4-864956de0902 tempest-GroupsV314Test-2113742378 None] Group tempest-GroupsV314Test-Group-1399995813: created successfully Sep 07 13:48:13 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c5e5ce1f-6a53-4667-89d4-864956de0902 tempest-GroupsV314Test-2113742378 None] Create group completed successfully. Sep 07 13:48:13 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-81b643f9-f4ae-465a-ab1a-f7502f30e498 tempest-SnapshotsActionsTest-1829708489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.1ccd838d-555b-48f6-aa06-6aaf06e5b7d3" returned: 0 in 0.442s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:13 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-81b643f9-f4ae-465a-ab1a-f7502f30e498 tempest-SnapshotsActionsTest-1829708489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:48:13 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[317a072a-2475-41f3-991a-4feb3ca343be]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-81b643f9-f4ae-465a-ab1a-f7502f30e498 tempest-SnapshotsActionsTest-1829708489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:13 devstack sudo[94072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d Sep 07 13:48:13 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:14 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-81b643f9-f4ae-465a-ab1a-f7502f30e498 tempest-SnapshotsActionsTest-1829708489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d" returned: 0 in 0.375s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-81b643f9-f4ae-465a-ab1a-f7502f30e498 tempest-SnapshotsActionsTest-1829708489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:48:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-81b643f9-f4ae-465a-ab1a-f7502f30e498 tempest-SnapshotsActionsTest-1829708489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.1ccd838d-555b-48f6-aa06-6aaf06e5b7d3 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:14 devstack sudo[94077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.1ccd838d-555b-48f6-aa06-6aaf06e5b7d3 Sep 07 13:48:14 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:14 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-81b643f9-f4ae-465a-ab1a-f7502f30e498 tempest-SnapshotsActionsTest-1829708489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.1ccd838d-555b-48f6-aa06-6aaf06e5b7d3" returned: 0 in 0.391s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-81b643f9-f4ae-465a-ab1a-f7502f30e498 tempest-SnapshotsActionsTest-1829708489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.1ccd838d-555b-48f6-aa06-6aaf06e5b7d3 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:14 devstack sudo[94083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.1ccd838d-555b-48f6-aa06-6aaf06e5b7d3 Sep 07 13:48:14 devstack sudo[94083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:14 devstack sudo[94083]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-81b643f9-f4ae-465a-ab1a-f7502f30e498 tempest-SnapshotsActionsTest-1829708489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.1ccd838d-555b-48f6-aa06-6aaf06e5b7d3" returned: 0 in 0.267s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:14 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-81b643f9-f4ae-465a-ab1a-f7502f30e498 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-quobyte-1ccd838d-555b-48f6-aa06-6aaf06e5b7d3" released by "_delete_snapshot" :: held 1.587s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:14 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-81b643f9-f4ae-465a-ab1a-f7502f30e498 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-quobyte-bf008b09-3bb5-4b9e-be93-5343cb4b690e" released by "delete_snapshot" :: held 1.617s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:14 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-81b643f9-f4ae-465a-ab1a-f7502f30e498 tempest-SnapshotsActionsTest-1829708489 None] Created reservations ['51cbc38b-e950-427b-bd52-61652944dd21', '46d410c4-fdee-4413-b950-f890161682a8', 'c66d9143-2e02-4507-a2ae-f64158d6e12f', '62f86925-ffb7-4dec-bfb6-dd944574003d'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:14 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-81b643f9-f4ae-465a-ab1a-f7502f30e498 tempest-SnapshotsActionsTest-1829708489 None] Delete snapshot completed successfully. Sep 07 13:48:14 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-81b643f9-f4ae-465a-ab1a-f7502f30e498 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-1ccd838d-555b-48f6-aa06-6aaf06e5b7d3-delete_snapshot" released by "delete_snapshot" :: held 1.806s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Flow 'volume_create_manager' (2ac1a008-627a-42b4-b768-d1937ea25a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af907f93-f2b6-49d3-b755-70ce27cf5b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af907f93-f2b6-49d3-b755-70ce27cf5b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-613822783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b71c94ad-7773-46f1-a776-63d2bc56af4f,host='devstack@QuobyteHD#QuobyteHD',id=0a1cbadd-5d48-43c2-9c81-947cc67e490b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6033603971934f508f81dc1ba7030228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:48:15Z,use_quota=True,user_id='bec88e29489e4d3d9c51fec5c08dd867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(698f158c-5b1b-4cd5-aeb4-abb609ab6ff1),volume_type_id=698f158c-5b1b-4cd5-aeb4-abb609ab6ff1)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c764d5c0-f106-453d-8091-e037a75551eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c764d5c0-f106-453d-8091-e037a75551eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3990e039-967f-46c2-a267-619ca0342f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3990e039-967f-46c2-a267-619ca0342f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a1cbadd-5d48-43c2-9c81-947cc67e490b', 'volume_name': 'volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43054e56-6ed9-4fc9-b7f7-c1326ea82269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43054e56-6ed9-4fc9-b7f7-c1326ea82269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa21530e-e2fd-4a7e-b049-d09418038e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:15 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Volume 0a1cbadd-5d48-43c2-9c81-947cc67e490b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b', 'volume_size': 1} Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b71c94ad-7773-46f1-a776-63d2bc56af4f,created_at=2026-09-07T11:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-613822783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b71c94ad-7773-46f1-a776-63d2bc56af4f,host='devstack@QuobyteHD#QuobyteHD',id=0a1cbadd-5d48-43c2-9c81-947cc67e490b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6033603971934f508f81dc1ba7030228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:48:15Z,use_quota=True,user_id='bec88e29489e4d3d9c51fec5c08dd867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(698f158c-5b1b-4cd5-aeb4-abb609ab6ff1),volume_type_id=698f158c-5b1b-4cd5-aeb4-abb609ab6ff1)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Creating volume 0a1cbadd-5d48-43c2-9c81-947cc67e490b {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:48:15 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:15 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b 1073741824 Sep 07 13:48:15 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-39e34e11-d9fe-482c-9c3d-423efcfca226 tempest-SnapshotsActionsTest-1280823395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:15 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b 1073741824" returned: 0 in 0.601s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:16 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b Sep 07 13:48:16 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:16 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b" returned: 0 in 0.267s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:48:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-39e34e11-d9fe-482c-9c3d-423efcfca226 tempest-SnapshotsActionsTest-1280823395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.617s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa21530e-e2fd-4a7e-b049-d09418038e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c55f73-5e5f-421a-9cdd-5ffb1b5c56a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-39e34e11-d9fe-482c-9c3d-423efcfca226 tempest-SnapshotsActionsTest-1280823395 None] Creating offline snapshot eb1181a8-9fce-4848-bb00-871b51a95773 of volume bf008b09-3bb5-4b9e-be93-5343cb4b690e {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:48:16 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Volume volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b (0a1cbadd-5d48-43c2-9c81-947cc67e490b): created successfully Sep 07 13:48:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c55f73-5e5f-421a-9cdd-5ffb1b5c56a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Flow 'volume_create_manager' (2ac1a008-627a-42b4-b768-d1937ea25a60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:48:16 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa31e27c-67dc-4d4f-9991-cb03d722d25a]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-39e34e11-d9fe-482c-9c3d-423efcfca226 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:16 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-cd3f65ff-67d9-46ee-8c8e-29140fb31a33 tempest-GroupsV314Test-2113742378 None] Created volume successfully. Sep 07 13:48:16 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d Sep 07 13:48:16 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:16 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-39e34e11-d9fe-482c-9c3d-423efcfca226 tempest-SnapshotsActionsTest-1280823395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d" returned: 0 in 0.518s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-39e34e11-d9fe-482c-9c3d-423efcfca226 tempest-SnapshotsActionsTest-1280823395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:48:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-39e34e11-d9fe-482c-9c3d-423efcfca226 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.eb1181a8-9fce-4848-bb00-871b51a95773 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:16 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.eb1181a8-9fce-4848-bb00-871b51a95773 1G Sep 07 13:48:16 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:17 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:48:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Flow 'volume_create_manager' (691d20fb-9c17-418d-9d41-18e358cd895f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:48:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859bd623-629a-4e4c-badd-3a8f7f215b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859bd623-629a-4e4c-badd-3a8f7f215b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1690018274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b19ec91-5f22-448a-8eec-574a3412c926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa8de455732541f59973f3f867a7ccca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:48:17Z,use_quota=True,user_id='3a60d86cd2bd4843924d088d1f8ebc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ba5746d-05fb-4453-b32e-5c497d72aa4f),volume_type_id=3ba5746d-05fb-4453-b32e-5c497d72aa4f)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38134f5-af29-41f4-80be-3b8d027b0504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38134f5-af29-41f4-80be-3b8d027b0504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b68ab5b6-a598-44ce-823c-0726ab74317e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b68ab5b6-a598-44ce-823c-0726ab74317e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b19ec91-5f22-448a-8eec-574a3412c926', 'volume_name': 'volume-0b19ec91-5f22-448a-8eec-574a3412c926', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6f1102-9e07-4cff-9c89-a229a52dffdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6f1102-9e07-4cff-9c89-a229a52dffdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47cacf42-ab02-4de1-825b-104cef1babb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:17 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Volume 0b19ec91-5f22-448a-8eec-574a3412c926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b19ec91-5f22-448a-8eec-574a3412c926', 'volume_size': 1} Sep 07 13:48:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:17 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-39e34e11-d9fe-482c-9c3d-423efcfca226 tempest-SnapshotsActionsTest-1280823395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.eb1181a8-9fce-4848-bb00-871b51a95773 1G" returned: 0 in 0.485s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-39e34e11-d9fe-482c-9c3d-423efcfca226 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.eb1181a8-9fce-4848-bb00-871b51a95773 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:17 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.eb1181a8-9fce-4848-bb00-871b51a95773 Sep 07 13:48:17 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:17 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-39e34e11-d9fe-482c-9c3d-423efcfca226 tempest-SnapshotsActionsTest-1280823395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.eb1181a8-9fce-4848-bb00-871b51a95773" returned: 0 in 0.331s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:17 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-39e34e11-d9fe-482c-9c3d-423efcfca226 tempest-SnapshotsActionsTest-1280823395 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.eb1181a8-9fce-4848-bb00-871b51a95773 is being set with open permissions: ugo+rw Sep 07 13:48:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-39e34e11-d9fe-482c-9c3d-423efcfca226 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.eb1181a8-9fce-4848-bb00-871b51a95773 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:17 devstack sudo[94116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.eb1181a8-9fce-4848-bb00-871b51a95773 Sep 07 13:48:17 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:18 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-39e34e11-d9fe-482c-9c3d-423efcfca226 tempest-SnapshotsActionsTest-1280823395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.eb1181a8-9fce-4848-bb00-871b51a95773" returned: 0 in 0.407s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-39e34e11-d9fe-482c-9c3d-423efcfca226 tempest-SnapshotsActionsTest-1280823395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.914s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.091s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1690018274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b19ec91-5f22-448a-8eec-574a3412c926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa8de455732541f59973f3f867a7ccca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:48:17Z,use_quota=True,user_id='3a60d86cd2bd4843924d088d1f8ebc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ba5746d-05fb-4453-b32e-5c497d72aa4f),volume_type_id=3ba5746d-05fb-4453-b32e-5c497d72aa4f)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:48:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Creating volume 0b19ec91-5f22-448a-8eec-574a3412c926 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:48:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:48:18 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:48:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0b19ec91-5f22-448a-8eec-574a3412c926 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:18 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0b19ec91-5f22-448a-8eec-574a3412c926 1073741824 Sep 07 13:48:18 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:18 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-39e34e11-d9fe-482c-9c3d-423efcfca226 tempest-SnapshotsActionsTest-1280823395 None] Create snapshot completed successfully Sep 07 13:48:18 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-d34848e4-17a8-4f2e-9730-8b91c2465d39 req-eaacc24e-8a05-457f-bee1-8bf664930eae tempest-ServerActionsTestOtherA-611322616 None] Terminate volume connection completed successfully. Sep 07 13:48:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-d34848e4-17a8-4f2e-9730-8b91c2465d39 req-eaacc24e-8a05-457f-bee1-8bf664930eae tempest-ServerActionsTestOtherA-611322616 None] Deleting attachment 940c133d-7c8f-478e-9f9b-6988e55c4f34. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:48:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:18 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0b19ec91-5f22-448a-8eec-574a3412c926 1073741824" returned: 0 in 0.543s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0b19ec91-5f22-448a-8eec-574a3412c926 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:18 devstack sudo[94130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0b19ec91-5f22-448a-8eec-574a3412c926 Sep 07 13:48:18 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:19 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0b19ec91-5f22-448a-8eec-574a3412c926" returned: 0 in 0.254s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.520s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:19 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Cloning volume 0a1cbadd-5d48-43c2-9c81-947cc67e490b to volume e146bb35-dfb2-493d-9c7c-a51e788b7e3d Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47cacf42-ab02-4de1-825b-104cef1babb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b19ec91-5f22-448a-8eec-574a3412c926', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0910188-4f1e-407a-90a8-494df741bddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Creating offline snapshot e277c2b7-f68f-48f3-b8d0-58e31b14f3df of volume 0a1cbadd-5d48-43c2-9c81-947cc67e490b {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:48:19 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Volume volume-0b19ec91-5f22-448a-8eec-574a3412c926 (0b19ec91-5f22-448a-8eec-574a3412c926): created successfully Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0910188-4f1e-407a-90a8-494df741bddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Flow 'volume_create_manager' (691d20fb-9c17-418d-9d41-18e358cd895f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d893741b-ac0d-4ed6-a3a6-ca8cef5645e9]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:19 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-13cc090f-ff32-4e94-97d2-b2922dbc8bdb tempest-VolumeTypesAccessTest-1477892020 None] Created volume successfully. Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5cd6e50c-3791-4cf4-808a-b1fa01ad0224 tempest-SnapshotsActionsTest-1829708489 None] Acquiring lock "cinder-eb1181a8-9fce-4848-bb00-871b51a95773-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5cd6e50c-3791-4cf4-808a-b1fa01ad0224 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-eb1181a8-9fce-4848-bb00-871b51a95773-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5cd6e50c-3791-4cf4-808a-b1fa01ad0224 tempest-SnapshotsActionsTest-1829708489 None] Acquiring lock "cinder-quobyte-bf008b09-3bb5-4b9e-be93-5343cb4b690e" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5cd6e50c-3791-4cf4-808a-b1fa01ad0224 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-quobyte-bf008b09-3bb5-4b9e-be93-5343cb4b690e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5cd6e50c-3791-4cf4-808a-b1fa01ad0224 tempest-SnapshotsActionsTest-1829708489 None] Acquiring lock "cinder-quobyte-eb1181a8-9fce-4848-bb00-871b51a95773" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5cd6e50c-3791-4cf4-808a-b1fa01ad0224 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-quobyte-eb1181a8-9fce-4848-bb00-871b51a95773" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-5cd6e50c-3791-4cf4-808a-b1fa01ad0224 tempest-SnapshotsActionsTest-1829708489 None] Deleting offline snapshot eb1181a8-9fce-4848-bb00-871b51a95773 of volume bf008b09-3bb5-4b9e-be93-5343cb4b690e {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:48:19 devstack sudo[94133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b Sep 07 13:48:19 devstack sudo[94133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-5cd6e50c-3791-4cf4-808a-b1fa01ad0224 tempest-SnapshotsActionsTest-1829708489 None] snapshot_file for this snap is: volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.eb1181a8-9fce-4848-bb00-871b51a95773 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[41af0385-986d-4880-99ac-c4ebb99a95ea]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5cd6e50c-3791-4cf4-808a-b1fa01ad0224 tempest-SnapshotsActionsTest-1829708489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.eb1181a8-9fce-4848-bb00-871b51a95773 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:19 devstack sudo[94141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.eb1181a8-9fce-4848-bb00-871b51a95773 Sep 07 13:48:19 devstack sudo[94141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:19 devstack sudo[94133]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b" returned: 0 in 0.477s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.e277c2b7-f68f-48f3-b8d0-58e31b14f3df 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:19 devstack sudo[94147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.e277c2b7-f68f-48f3-b8d0-58e31b14f3df 1G Sep 07 13:48:19 devstack sudo[94147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:19 devstack sudo[94141]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5cd6e50c-3791-4cf4-808a-b1fa01ad0224 tempest-SnapshotsActionsTest-1829708489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.eb1181a8-9fce-4848-bb00-871b51a95773" returned: 0 in 0.460s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-5cd6e50c-3791-4cf4-808a-b1fa01ad0224 tempest-SnapshotsActionsTest-1829708489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e4ff22-b82c-48b2-a30a-54b7152e838a]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5cd6e50c-3791-4cf4-808a-b1fa01ad0224 tempest-SnapshotsActionsTest-1829708489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:20 devstack sudo[94164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d Sep 07 13:48:20 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:20 devstack sudo[94147]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.e277c2b7-f68f-48f3-b8d0-58e31b14f3df 1G" returned: 0 in 0.694s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.e277c2b7-f68f-48f3-b8d0-58e31b14f3df {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:20 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.e277c2b7-f68f-48f3-b8d0-58e31b14f3df Sep 07 13:48:20 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:20 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5cd6e50c-3791-4cf4-808a-b1fa01ad0224 tempest-SnapshotsActionsTest-1829708489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d" returned: 0 in 0.538s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-5cd6e50c-3791-4cf4-808a-b1fa01ad0224 tempest-SnapshotsActionsTest-1829708489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:48:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5cd6e50c-3791-4cf4-808a-b1fa01ad0224 tempest-SnapshotsActionsTest-1829708489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.eb1181a8-9fce-4848-bb00-871b51a95773 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:20 devstack sudo[94186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.eb1181a8-9fce-4848-bb00-871b51a95773 Sep 07 13:48:20 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-abef9c20-fba0-4a48-b6ee-8515cb09abd2 tempest-VolumeTypesAccessTest-1477892020 None] Acquiring lock "cinder-0b19ec91-5f22-448a-8eec-574a3412c926-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-abef9c20-fba0-4a48-b6ee-8515cb09abd2 tempest-VolumeTypesAccessTest-1477892020 None] Lock "cinder-0b19ec91-5f22-448a-8eec-574a3412c926-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-abef9c20-fba0-4a48-b6ee-8515cb09abd2 tempest-VolumeTypesAccessTest-1477892020 None] Acquiring lock "cinder-quobyte-0b19ec91-5f22-448a-8eec-574a3412c926" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-abef9c20-fba0-4a48-b6ee-8515cb09abd2 tempest-VolumeTypesAccessTest-1477892020 None] Lock "cinder-quobyte-0b19ec91-5f22-448a-8eec-574a3412c926" acquired by "delete_volume" :: waited 0.043s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:20 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a82ad2-f098-4c60-9656-6953183a3d20]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-abef9c20-fba0-4a48-b6ee-8515cb09abd2 tempest-VolumeTypesAccessTest-1477892020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0b19ec91-5f22-448a-8eec-574a3412c926 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:20 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.e277c2b7-f68f-48f3-b8d0-58e31b14f3df" returned: 0 in 0.435s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:20 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.e277c2b7-f68f-48f3-b8d0-58e31b14f3df is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:48:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.e277c2b7-f68f-48f3-b8d0-58e31b14f3df {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:20 devstack sudo[94194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.e277c2b7-f68f-48f3-b8d0-58e31b14f3df Sep 07 13:48:20 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:20 devstack sudo[94192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0b19ec91-5f22-448a-8eec-574a3412c926 Sep 07 13:48:20 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:21 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5cd6e50c-3791-4cf4-808a-b1fa01ad0224 tempest-SnapshotsActionsTest-1829708489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.eb1181a8-9fce-4848-bb00-871b51a95773" returned: 0 in 0.637s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5cd6e50c-3791-4cf4-808a-b1fa01ad0224 tempest-SnapshotsActionsTest-1829708489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.eb1181a8-9fce-4848-bb00-871b51a95773 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:21 devstack sudo[94204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.eb1181a8-9fce-4848-bb00-871b51a95773 Sep 07 13:48:21 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:21 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-abef9c20-fba0-4a48-b6ee-8515cb09abd2 tempest-VolumeTypesAccessTest-1477892020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0b19ec91-5f22-448a-8eec-574a3412c926" returned: 0 in 0.463s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-abef9c20-fba0-4a48-b6ee-8515cb09abd2 tempest-VolumeTypesAccessTest-1477892020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0b19ec91-5f22-448a-8eec-574a3412c926 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:21 devstack sudo[94208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0b19ec91-5f22-448a-8eec-574a3412c926 Sep 07 13:48:21 devstack sudo[94208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:21 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.e277c2b7-f68f-48f3-b8d0-58e31b14f3df" returned: 0 in 0.435s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:21 devstack sudo[94210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.info Sep 07 13:48:21 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:21 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5cd6e50c-3791-4cf4-808a-b1fa01ad0224 tempest-SnapshotsActionsTest-1829708489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.eb1181a8-9fce-4848-bb00-871b51a95773" returned: 0 in 0.407s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:21 devstack sudo[94208]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-abef9c20-fba0-4a48-b6ee-8515cb09abd2 tempest-VolumeTypesAccessTest-1477892020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0b19ec91-5f22-448a-8eec-574a3412c926" returned: 0 in 0.349s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5cd6e50c-3791-4cf4-808a-b1fa01ad0224 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-quobyte-eb1181a8-9fce-4848-bb00-871b51a95773" released by "_delete_snapshot" :: held 2.211s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5cd6e50c-3791-4cf4-808a-b1fa01ad0224 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-quobyte-bf008b09-3bb5-4b9e-be93-5343cb4b690e" released by "delete_snapshot" :: held 2.253s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-abef9c20-fba0-4a48-b6ee-8515cb09abd2 tempest-VolumeTypesAccessTest-1477892020 None] Lock "cinder-quobyte-0b19ec91-5f22-448a-8eec-574a3412c926" released by "delete_volume" :: held 0.882s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:21 devstack cinder-volume[87571]: WARNING cinder.quota [None req-abef9c20-fba0-4a48-b6ee-8515cb09abd2 tempest-VolumeTypesAccessTest-1477892020 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1064684738 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1064684738, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:48:21 devstack cinder-volume[87571]: WARNING cinder.quota [None req-abef9c20-fba0-4a48-b6ee-8515cb09abd2 tempest-VolumeTypesAccessTest-1477892020 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1064684738 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1064684738, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:48:21 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-abef9c20-fba0-4a48-b6ee-8515cb09abd2 tempest-VolumeTypesAccessTest-1477892020 None] Created reservations ['1eff4b7c-bc77-4e0a-a036-57b7f54afcd9', 'a6338d9c-0577-4851-9796-b0b5d19ba9db', 'ecb73c66-0afd-4100-a109-e58eaa0deca3', 'f1cf7c04-cb14-4e9d-8a3e-1a3f21adf7ea'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:21 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-5cd6e50c-3791-4cf4-808a-b1fa01ad0224 tempest-SnapshotsActionsTest-1829708489 None] Created reservations ['3beab3ec-14f8-48f3-95f2-f4905b3770d4', 'ee5aad48-f470-482e-aaaf-696eb90ff93c', '96cd4431-f5dd-4efc-8838-cf86cf674965', '75703f12-6054-477b-b4f8-9e1ba3234225'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:21 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.info" returned: 0 in 0.430s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:21 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:48:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:21 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.info Sep 07 13:48:21 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-abef9c20-fba0-4a48-b6ee-8515cb09abd2 tempest-VolumeTypesAccessTest-1477892020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-abef9c20-fba0-4a48-b6ee-8515cb09abd2 tempest-VolumeTypesAccessTest-1477892020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-abef9c20-fba0-4a48-b6ee-8515cb09abd2 tempest-VolumeTypesAccessTest-1477892020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-abef9c20-fba0-4a48-b6ee-8515cb09abd2 tempest-VolumeTypesAccessTest-1477892020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-abef9c20-fba0-4a48-b6ee-8515cb09abd2 tempest-VolumeTypesAccessTest-1477892020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-abef9c20-fba0-4a48-b6ee-8515cb09abd2 tempest-VolumeTypesAccessTest-1477892020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:21 devstack sudo[94218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:48:21 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:21 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-5cd6e50c-3791-4cf4-808a-b1fa01ad0224 tempest-SnapshotsActionsTest-1829708489 None] Delete snapshot completed successfully. Sep 07 13:48:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5cd6e50c-3791-4cf4-808a-b1fa01ad0224 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-eb1181a8-9fce-4848-bb00-871b51a95773-delete_snapshot" released by "delete_snapshot" :: held 2.608s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:22 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.info" returned: 0 in 0.343s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Acquiring lock "cinder-quobyte-e146bb35-dfb2-493d-9c7c-a51e788b7e3d" by "_copy_volume_from_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:22 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Lock "cinder-quobyte-e146bb35-dfb2-493d-9c7c-a51e788b7e3d" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] snapshot: e277c2b7-f68f-48f3-b8d0-58e31b14f3df, volume: e146bb35-dfb2-493d-9c7c-a51e788b7e3d, {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-abef9c20-fba0-4a48-b6ee-8515cb09abd2 tempest-VolumeTypesAccessTest-1477892020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.328s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-abef9c20-fba0-4a48-b6ee-8515cb09abd2 tempest-VolumeTypesAccessTest-1477892020 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:48:22 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-abef9c20-fba0-4a48-b6ee-8515cb09abd2 tempest-VolumeTypesAccessTest-1477892020 None] Deleted volume successfully. Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c9120e-4873-49d8-b585-7aac16cb61ed]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.e277c2b7-f68f-48f3-b8d0-58e31b14f3df {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-abef9c20-fba0-4a48-b6ee-8515cb09abd2 tempest-VolumeTypesAccessTest-1477892020 None] Lock "cinder-0b19ec91-5f22-448a-8eec-574a3412c926-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:22 devstack sudo[94222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.e277c2b7-f68f-48f3-b8d0-58e31b14f3df Sep 07 13:48:22 devstack sudo[94222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:22 devstack sudo[94222]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.e277c2b7-f68f-48f3-b8d0-58e31b14f3df" returned: 0 in 0.410s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[58733383-ac2f-4b2c-baa7-b34407f71095]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:22 devstack sudo[94227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b Sep 07 13:48:22 devstack sudo[94227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-68e7f84b-766d-4cf3-9bdb-eac6cf40af40 tempest-SnapshotsActionsTest-1280823395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:22 devstack sudo[94227]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b" returned: 0 in 0.386s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Creating direct copy from snapshot {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG cinder.utils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Path /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e146bb35-dfb2-493d-9c7c-a51e788b7e3d not found in is_blk_device check {{(pid=87571) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 13:48:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e146bb35-dfb2-493d-9c7c-a51e788b7e3d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:22 devstack sudo[94232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e146bb35-dfb2-493d-9c7c-a51e788b7e3d Sep 07 13:48:22 devstack sudo[94232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:28 devstack sudo[94232]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e146bb35-dfb2-493d-9c7c-a51e788b7e3d" returned: 0 in 5.233s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b, size 1024.00 MB, duration 5.23 sec, destination /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e146bb35-dfb2-493d-9c7c-a51e788b7e3d {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:48:28 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Converted 1024.00 MB image at 195.63 MB/s Sep 07 13:48:28 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e146bb35-dfb2-493d-9c7c-a51e788b7e3d is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e146bb35-dfb2-493d-9c7c-a51e788b7e3d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:28 devstack sudo[94246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e146bb35-dfb2-493d-9c7c-a51e788b7e3d Sep 07 13:48:28 devstack sudo[94246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:28 devstack sudo[94248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:48:28 devstack sudo[94248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:28 devstack sudo[94246]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e146bb35-dfb2-493d-9c7c-a51e788b7e3d" returned: 0 in 0.295s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Lock "cinder-quobyte-e146bb35-dfb2-493d-9c7c-a51e788b7e3d" released by "_copy_volume_from_snapshot" :: held 6.423s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=133,cinder:UPDATE=154,cinder:INSERT=30,cinder:DELETE=5 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Acquiring lock "cinder-quobyte-e277c2b7-f68f-48f3-b8d0-58e31b14f3df" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Lock "cinder-quobyte-e277c2b7-f68f-48f3-b8d0-58e31b14f3df" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Deleting offline snapshot e277c2b7-f68f-48f3-b8d0-58e31b14f3df of volume 0a1cbadd-5d48-43c2-9c81-947cc67e490b {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] snapshot_file for this snap is: volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.e277c2b7-f68f-48f3-b8d0-58e31b14f3df {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6122a0-331b-4dbc-8a4b-c1d3c01c688e]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.e277c2b7-f68f-48f3-b8d0-58e31b14f3df {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:28 devstack sudo[94248]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.360s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager._thread_info {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread count: 8 {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread info: [<_MainThread(MainThread, started 132147689414784)>, , , , , , , ] {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=159,cinder:UPDATE=123,cinder:INSERT=33,cinder:DELETE=11 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Flow 'volume_create_manager' (625307ff-0cff-4653-8b83-0b4cf4a6155c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ae1739-95ed-4fc3-98de-df3f95cb0e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ae1739-95ed-4fc3-98de-df3f95cb0e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1366074722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b253d3-6e87-4ec9-ba08-60da34ee6875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050bb3bb5a2e4059a7bb924e2bcbf8a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:48:29Z,use_quota=True,user_id='7dc270088b894d91aa05542bc3edb4af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff89bf94-f069-4387-9632-3dbd2d288cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff89bf94-f069-4387-9632-3dbd2d288cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (531215df-fb81-4ec7-b7a8-7a3171d83c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:28 devstack cinder-volume[87571]: DEBUG cinder.image.glance [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Creating Keystone auth plugin from conf {{(pid=87571) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 13:48:28 devstack sudo[94252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.e277c2b7-f68f-48f3-b8d0-58e31b14f3df Sep 07 13:48:28 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:29 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.e277c2b7-f68f-48f3-b8d0-58e31b14f3df" returned: 0 in 0.456s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:48:29 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62a3935-6c2c-4d57-9537-b198f4f17fa5]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:29 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b Sep 07 13:48:29 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (531215df-fb81-4ec7-b7a8-7a3171d83c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '49b253d3-6e87-4ec9-ba08-60da34ee6875', 'volume_name': 'volume-49b253d3-6e87-4ec9-ba08-60da34ee6875', 'volume_size': 1, 'image_id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d9d2114dd14b01a04867c896fdabaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'created_at': datetime.datetime(2026, 9, 7, 11, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdbd1541-2076-47bf-b26a-15662727e644/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6bae805-9ca0-4f31-bb58-2e4ede0a96ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6bae805-9ca0-4f31-bb58-2e4ede0a96ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f650388-685b-4387-beee-e6c72c9a3fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:29 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Volume 49b253d3-6e87-4ec9-ba08-60da34ee6875: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-49b253d3-6e87-4ec9-ba08-60da34ee6875', 'volume_size': 1, 'image_id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d9d2114dd14b01a04867c896fdabaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'created_at': datetime.datetime(2026, 9, 7, 11, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdbd1541-2076-47bf-b26a-15662727e644/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 13:48:29 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Trying to clone 49b253d3-6e87-4ec9-ba08-60da34ee6875 from image bdbd1541-2076-47bf-b26a-15662727e644 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}]). {{(pid=87571) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1099}} Sep 07 13:48:29 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b" returned: 0 in 0.658s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.e277c2b7-f68f-48f3-b8d0-58e31b14f3df {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:29 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.e277c2b7-f68f-48f3-b8d0-58e31b14f3df Sep 07 13:48:29 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:29 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_txdof99pdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 13:48:29 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Image download 20.69 MB at 20.69 MB/s Sep 07 13:48:29 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1e4979-3e65-45e2-8a11-bccdedea4f18]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_txdof99pdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:30 devstack sudo[94285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_txdof99pdevstack@QuobyteHD Sep 07 13:48:30 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:30 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.e277c2b7-f68f-48f3-b8d0-58e31b14f3df" returned: 0 in 0.409s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.e277c2b7-f68f-48f3-b8d0-58e31b14f3df {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:30 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.e277c2b7-f68f-48f3-b8d0-58e31b14f3df Sep 07 13:48:30 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:30 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_txdof99pdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:30 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Temporary image bdbd1541-2076-47bf-b26a-15662727e644 is fetched for user 7dc270088b894d91aa05542bc3edb4af. {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 13:48:30 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae3283e-674a-409c-850e-3a31675fcf33]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_txdof99pdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:30 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b.e277c2b7-f68f-48f3-b8d0-58e31b14f3df" returned: 0 in 0.298s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:30 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_txdof99pdevstack@QuobyteHD Sep 07 13:48:30 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Lock "cinder-quobyte-e277c2b7-f68f-48f3-b8d0-58e31b14f3df" released by "_delete_snapshot" :: held 1.966s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.493s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-68e7f84b-766d-4cf3-9bdb-eac6cf40af40 tempest-SnapshotsActionsTest-1280823395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.682s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-68e7f84b-766d-4cf3-9bdb-eac6cf40af40 tempest-SnapshotsActionsTest-1280823395 None] Creating offline snapshot f6c1c10d-5542-45c1-aa90-5597a3858416 of volume bf008b09-3bb5-4b9e-be93-5343cb4b690e {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:48:30 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce28eae9-7496-40d7-a0e7-8d49e2712db4]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-68e7f84b-766d-4cf3-9bdb-eac6cf40af40 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:30 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-a59475d6-47b3-440b-bde2-b3b631a00088 tempest-GroupsV314Test-2113742378 None] Create group from source-group-b71c94ad-7773-46f1-a776-63d2bc56af4f completed successfully. Sep 07 13:48:30 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d Sep 07 13:48:30 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:30 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_txdof99pdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:31 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-68e7f84b-766d-4cf3-9bdb-eac6cf40af40 tempest-SnapshotsActionsTest-1280823395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d" returned: 0 in 0.393s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-68e7f84b-766d-4cf3-9bdb-eac6cf40af40 tempest-SnapshotsActionsTest-1280823395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:48:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-68e7f84b-766d-4cf3-9bdb-eac6cf40af40 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f6c1c10d-5542-45c1-aa90-5597a3858416 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:31 devstack sudo[94306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f6c1c10d-5542-45c1-aa90-5597a3858416 1G Sep 07 13:48:31 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:31 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-68e7f84b-766d-4cf3-9bdb-eac6cf40af40 tempest-SnapshotsActionsTest-1280823395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f6c1c10d-5542-45c1-aa90-5597a3858416 1G" returned: 0 in 0.467s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-68e7f84b-766d-4cf3-9bdb-eac6cf40af40 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f6c1c10d-5542-45c1-aa90-5597a3858416 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:31 devstack sudo[94312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f6c1c10d-5542-45c1-aa90-5597a3858416 Sep 07 13:48:31 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:31 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-16ed9c1c-e313-475d-9c57-147ce865441f tempest-GroupsV314Test-2113742378 None] Acquiring lock "cinder-quobyte-e146bb35-dfb2-493d-9c7c-a51e788b7e3d" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:31 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-68e7f84b-766d-4cf3-9bdb-eac6cf40af40 tempest-SnapshotsActionsTest-1280823395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f6c1c10d-5542-45c1-aa90-5597a3858416" returned: 0 in 0.327s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:31 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-68e7f84b-766d-4cf3-9bdb-eac6cf40af40 tempest-SnapshotsActionsTest-1280823395 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f6c1c10d-5542-45c1-aa90-5597a3858416 is being set with open permissions: ugo+rw Sep 07 13:48:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-68e7f84b-766d-4cf3-9bdb-eac6cf40af40 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f6c1c10d-5542-45c1-aa90-5597a3858416 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:31 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-16ed9c1c-e313-475d-9c57-147ce865441f tempest-GroupsV314Test-2113742378 None] Lock "cinder-quobyte-e146bb35-dfb2-493d-9c7c-a51e788b7e3d" acquired by "delete_volume" :: waited 0.036s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:31 devstack sudo[94317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f6c1c10d-5542-45c1-aa90-5597a3858416 Sep 07 13:48:31 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:31 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e38ba5c-e7f0-4770-9da8-dede196ba5e8]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-16ed9c1c-e313-475d-9c57-147ce865441f tempest-GroupsV314Test-2113742378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e146bb35-dfb2-493d-9c7c-a51e788b7e3d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:32 devstack sudo[94319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e146bb35-dfb2-493d-9c7c-a51e788b7e3d Sep 07 13:48:32 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:32 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-68e7f84b-766d-4cf3-9bdb-eac6cf40af40 tempest-SnapshotsActionsTest-1280823395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f6c1c10d-5542-45c1-aa90-5597a3858416" returned: 0 in 0.355s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-68e7f84b-766d-4cf3-9bdb-eac6cf40af40 tempest-SnapshotsActionsTest-1280823395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.658s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.446s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1366074722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b253d3-6e87-4ec9-ba08-60da34ee6875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050bb3bb5a2e4059a7bb924e2bcbf8a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:48:29Z,use_quota=True,user_id='7dc270088b894d91aa05542bc3edb4af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Creating volume 49b253d3-6e87-4ec9-ba08-60da34ee6875 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:48:32 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49b253d3-6e87-4ec9-ba08-60da34ee6875 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:32 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49b253d3-6e87-4ec9-ba08-60da34ee6875 1073741824 Sep 07 13:48:32 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:32 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-68e7f84b-766d-4cf3-9bdb-eac6cf40af40 tempest-SnapshotsActionsTest-1280823395 None] Create snapshot completed successfully Sep 07 13:48:32 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-16ed9c1c-e313-475d-9c57-147ce865441f tempest-GroupsV314Test-2113742378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e146bb35-dfb2-493d-9c7c-a51e788b7e3d" returned: 0 in 0.488s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-16ed9c1c-e313-475d-9c57-147ce865441f tempest-GroupsV314Test-2113742378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e146bb35-dfb2-493d-9c7c-a51e788b7e3d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:32 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e146bb35-dfb2-493d-9c7c-a51e788b7e3d Sep 07 13:48:32 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dd6be72d-a166-4e65-89b6-26e7e533e726 tempest-SnapshotsActionsTest-1829708489 None] Acquiring lock "cinder-f6c1c10d-5542-45c1-aa90-5597a3858416-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dd6be72d-a166-4e65-89b6-26e7e533e726 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-f6c1c10d-5542-45c1-aa90-5597a3858416-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dd6be72d-a166-4e65-89b6-26e7e533e726 tempest-SnapshotsActionsTest-1829708489 None] Acquiring lock "cinder-quobyte-bf008b09-3bb5-4b9e-be93-5343cb4b690e" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dd6be72d-a166-4e65-89b6-26e7e533e726 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-quobyte-bf008b09-3bb5-4b9e-be93-5343cb4b690e" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dd6be72d-a166-4e65-89b6-26e7e533e726 tempest-SnapshotsActionsTest-1829708489 None] Acquiring lock "cinder-quobyte-f6c1c10d-5542-45c1-aa90-5597a3858416" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dd6be72d-a166-4e65-89b6-26e7e533e726 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-quobyte-f6c1c10d-5542-45c1-aa90-5597a3858416" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-dd6be72d-a166-4e65-89b6-26e7e533e726 tempest-SnapshotsActionsTest-1829708489 None] Deleting offline snapshot f6c1c10d-5542-45c1-aa90-5597a3858416 of volume bf008b09-3bb5-4b9e-be93-5343cb4b690e {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:48:32 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-dd6be72d-a166-4e65-89b6-26e7e533e726 tempest-SnapshotsActionsTest-1829708489 None] snapshot_file for this snap is: volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f6c1c10d-5542-45c1-aa90-5597a3858416 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-16ed9c1c-e313-475d-9c57-147ce865441f tempest-GroupsV314Test-2113742378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e146bb35-dfb2-493d-9c7c-a51e788b7e3d" returned: 0 in 0.320s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cdfdfb-bce4-4df1-8ca9-e22389e4fa3b]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-16ed9c1c-e313-475d-9c57-147ce865441f tempest-GroupsV314Test-2113742378 None] Lock "cinder-quobyte-e146bb35-dfb2-493d-9c7c-a51e788b7e3d" released by "delete_volume" :: held 0.860s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dd6be72d-a166-4e65-89b6-26e7e533e726 tempest-SnapshotsActionsTest-1829708489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f6c1c10d-5542-45c1-aa90-5597a3858416 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-16ed9c1c-e313-475d-9c57-147ce865441f tempest-GroupsV314Test-2113742378 None] Created reservations ['563ef2ce-f777-45e5-bc3c-2cce7abad3f6'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:32 devstack cinder-volume[87571]: WARNING cinder.quota [None req-16ed9c1c-e313-475d-9c57-147ce865441f tempest-GroupsV314Test-2113742378 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-855899007 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-855899007, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:48:32 devstack cinder-volume[87571]: WARNING cinder.quota [None req-16ed9c1c-e313-475d-9c57-147ce865441f tempest-GroupsV314Test-2113742378 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-855899007 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-855899007, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-16ed9c1c-e313-475d-9c57-147ce865441f tempest-GroupsV314Test-2113742378 None] Created reservations ['a9becad0-201c-4282-98e3-cff1d5df6c71', 'bb5889ab-0f0f-451c-8b53-4a9eb5929c8a', '6102687b-ccab-4747-833b-f53fe2bbb256', 'b866fc22-b7d0-4938-be24-eedb09dbf866'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:32 devstack sudo[94334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f6c1c10d-5542-45c1-aa90-5597a3858416 Sep 07 13:48:32 devstack sudo[94334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:32 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49b253d3-6e87-4ec9-ba08-60da34ee6875 1073741824" returned: 0 in 0.640s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49b253d3-6e87-4ec9-ba08-60da34ee6875 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:32 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49b253d3-6e87-4ec9-ba08-60da34ee6875 Sep 07 13:48:32 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-16ed9c1c-e313-475d-9c57-147ce865441f tempest-GroupsV314Test-2113742378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-16ed9c1c-e313-475d-9c57-147ce865441f tempest-GroupsV314Test-2113742378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-16ed9c1c-e313-475d-9c57-147ce865441f tempest-GroupsV314Test-2113742378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-16ed9c1c-e313-475d-9c57-147ce865441f tempest-GroupsV314Test-2113742378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-16ed9c1c-e313-475d-9c57-147ce865441f tempest-GroupsV314Test-2113742378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-16ed9c1c-e313-475d-9c57-147ce865441f tempest-GroupsV314Test-2113742378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:33 devstack sudo[94338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:48:33 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:33 devstack sudo[94334]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dd6be72d-a166-4e65-89b6-26e7e533e726 tempest-SnapshotsActionsTest-1829708489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f6c1c10d-5542-45c1-aa90-5597a3858416" returned: 0 in 0.558s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-dd6be72d-a166-4e65-89b6-26e7e533e726 tempest-SnapshotsActionsTest-1829708489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:48:33 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe66aec-92d3-446a-8a54-390da9a9d59e]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dd6be72d-a166-4e65-89b6-26e7e533e726 tempest-SnapshotsActionsTest-1829708489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:33 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49b253d3-6e87-4ec9-ba08-60da34ee6875" returned: 0 in 0.405s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:48:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:33 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-16ed9c1c-e313-475d-9c57-147ce865441f tempest-GroupsV314Test-2113742378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.320s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:33 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-16ed9c1c-e313-475d-9c57-147ce865441f tempest-GroupsV314Test-2113742378 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:48:33 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-16ed9c1c-e313-475d-9c57-147ce865441f tempest-GroupsV314Test-2113742378 None] Delete group completed successfully. Sep 07 13:48:33 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Attempting download of bdbd1541-2076-47bf-b26a-15662727e644 ((None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}])) to volume 49b253d3-6e87-4ec9-ba08-60da34ee6875. {{(pid=87571) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 13:48:33 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bb0c12-466a-4d0e-8b8c-72c32092fd44]: (4, 'raw') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_m_45t8_n {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:33 devstack sudo[94345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d Sep 07 13:48:33 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:33 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_m_45t8_n Sep 07 13:48:33 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:33 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dd6be72d-a166-4e65-89b6-26e7e533e726 tempest-SnapshotsActionsTest-1829708489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d" returned: 0 in 0.452s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-dd6be72d-a166-4e65-89b6-26e7e533e726 tempest-SnapshotsActionsTest-1829708489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:48:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dd6be72d-a166-4e65-89b6-26e7e533e726 tempest-SnapshotsActionsTest-1829708489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f6c1c10d-5542-45c1-aa90-5597a3858416 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:33 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f6c1c10d-5542-45c1-aa90-5597a3858416 Sep 07 13:48:33 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:33 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_m_45t8_n" returned: 0 in 0.380s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_m_45t8_n {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:33 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_m_45t8_n Sep 07 13:48:33 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:34 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_m_45t8_n" returned: 1 in 0.352s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_m_45t8_n' failed. Not Retrying. {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 13:48:34 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f560803b-ebe7-42d6-a53b-22df67939d73]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_txdof99pdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:34 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dd6be72d-a166-4e65-89b6-26e7e533e726 tempest-SnapshotsActionsTest-1829708489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f6c1c10d-5542-45c1-aa90-5597a3858416" returned: 0 in 0.441s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dd6be72d-a166-4e65-89b6-26e7e533e726 tempest-SnapshotsActionsTest-1829708489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f6c1c10d-5542-45c1-aa90-5597a3858416 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:34 devstack sudo[94366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f6c1c10d-5542-45c1-aa90-5597a3858416 Sep 07 13:48:34 devstack sudo[94366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:34 devstack sudo[94365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_txdof99pdevstack@QuobyteHD Sep 07 13:48:34 devstack sudo[94365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-10493680-63e1-4129-bb3a-f84f25156f9a tempest-GroupsV314Test-2113742378 None] Acquiring lock "cinder-quobyte-0a1cbadd-5d48-43c2-9c81-947cc67e490b" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-10493680-63e1-4129-bb3a-f84f25156f9a tempest-GroupsV314Test-2113742378 None] Lock "cinder-quobyte-0a1cbadd-5d48-43c2-9c81-947cc67e490b" acquired by "delete_volume" :: waited 0.026s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:34 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbda18f6-306a-4c1b-86d4-987734f48cd7]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-10493680-63e1-4129-bb3a-f84f25156f9a tempest-GroupsV314Test-2113742378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:34 devstack sudo[94366]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dd6be72d-a166-4e65-89b6-26e7e533e726 tempest-SnapshotsActionsTest-1829708489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f6c1c10d-5542-45c1-aa90-5597a3858416" returned: 0 in 0.438s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:34 devstack sudo[94369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b Sep 07 13:48:34 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dd6be72d-a166-4e65-89b6-26e7e533e726 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-quobyte-f6c1c10d-5542-45c1-aa90-5597a3858416" released by "_delete_snapshot" :: held 2.029s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dd6be72d-a166-4e65-89b6-26e7e533e726 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-quobyte-bf008b09-3bb5-4b9e-be93-5343cb4b690e" released by "delete_snapshot" :: held 2.059s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:34 devstack sudo[94365]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_txdof99pdevstack@QuobyteHD" returned: 0 in 0.593s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:34 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] bdbd1541-2076-47bf-b26a-15662727e644 was qcow2, converting to qcow2 {{(pid=87571) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 13:48:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_txdof99pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49b253d3-6e87-4ec9-ba08-60da34ee6875 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:34 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_txdof99pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49b253d3-6e87-4ec9-ba08-60da34ee6875 Sep 07 13:48:34 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:34 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-dd6be72d-a166-4e65-89b6-26e7e533e726 tempest-SnapshotsActionsTest-1829708489 None] Created reservations ['c4da6fcc-7e60-419d-90c5-f4733ae38dcf', '62523eee-5021-47ce-9baf-31d82d7d8d0e', 'eb48e125-4d58-4d5f-a110-14c3a409c698', '3a0d8225-d0a9-48d3-b99e-5967237805a9'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:34 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-dd6be72d-a166-4e65-89b6-26e7e533e726 tempest-SnapshotsActionsTest-1829708489 None] Delete snapshot completed successfully. Sep 07 13:48:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dd6be72d-a166-4e65-89b6-26e7e533e726 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-f6c1c10d-5542-45c1-aa90-5597a3858416-delete_snapshot" released by "delete_snapshot" :: held 2.292s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:34 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-10493680-63e1-4129-bb3a-f84f25156f9a tempest-GroupsV314Test-2113742378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b" returned: 0 in 0.468s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-10493680-63e1-4129-bb3a-f84f25156f9a tempest-GroupsV314Test-2113742378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:34 devstack sudo[94380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b Sep 07 13:48:34 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:35 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-10493680-63e1-4129-bb3a-f84f25156f9a tempest-GroupsV314Test-2113742378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0a1cbadd-5d48-43c2-9c81-947cc67e490b" returned: 0 in 0.254s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:35 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-10493680-63e1-4129-bb3a-f84f25156f9a tempest-GroupsV314Test-2113742378 None] Lock "cinder-quobyte-0a1cbadd-5d48-43c2-9c81-947cc67e490b" released by "delete_volume" :: held 0.780s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:35 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-10493680-63e1-4129-bb3a-f84f25156f9a tempest-GroupsV314Test-2113742378 None] Created reservations ['71f320ee-1e91-49a8-b0cc-a546a634ebf1'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:35 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-10493680-63e1-4129-bb3a-f84f25156f9a tempest-GroupsV314Test-2113742378 None] Created reservations ['84f7ee66-447f-4302-a2ae-7eca48d4bff8', 'c1aa1203-aeec-4a76-a324-4b901c9df284', 'e4cc14ef-195f-463c-88a0-d39d13811782', 'c02c07f8-bd57-4f06-9d85-a95838297444'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-10493680-63e1-4129-bb3a-f84f25156f9a tempest-GroupsV314Test-2113742378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-10493680-63e1-4129-bb3a-f84f25156f9a tempest-GroupsV314Test-2113742378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:35 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-10493680-63e1-4129-bb3a-f84f25156f9a tempest-GroupsV314Test-2113742378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:35 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-10493680-63e1-4129-bb3a-f84f25156f9a tempest-GroupsV314Test-2113742378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-10493680-63e1-4129-bb3a-f84f25156f9a tempest-GroupsV314Test-2113742378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-10493680-63e1-4129-bb3a-f84f25156f9a tempest-GroupsV314Test-2113742378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:35 devstack sudo[94388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:48:35 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:35 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-10493680-63e1-4129-bb3a-f84f25156f9a tempest-GroupsV314Test-2113742378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.432s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:35 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-10493680-63e1-4129-bb3a-f84f25156f9a tempest-GroupsV314Test-2113742378 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:48:35 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-10493680-63e1-4129-bb3a-f84f25156f9a tempest-GroupsV314Test-2113742378 None] Delete group completed successfully. Sep 07 13:48:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-edd33acd-a237-41c1-9e16-572511417203 tempest-SnapshotsActionsTest-1280823395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-edd33acd-a237-41c1-9e16-572511417203 tempest-SnapshotsActionsTest-1280823395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-edd33acd-a237-41c1-9e16-572511417203 tempest-SnapshotsActionsTest-1280823395 None] Creating offline snapshot f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd of volume bf008b09-3bb5-4b9e-be93-5343cb4b690e {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:48:36 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ccf560-6b17-48f7-99c9-32e2f86bf1d2]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-edd33acd-a237-41c1-9e16-572511417203 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:36 devstack sudo[94391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d Sep 07 13:48:36 devstack sudo[94391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:36 devstack sudo[94391]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-edd33acd-a237-41c1-9e16-572511417203 tempest-SnapshotsActionsTest-1280823395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d" returned: 0 in 0.484s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-edd33acd-a237-41c1-9e16-572511417203 tempest-SnapshotsActionsTest-1280823395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:48:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-edd33acd-a237-41c1-9e16-572511417203 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:36 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd 1G Sep 07 13:48:36 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:36 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_txdof99pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49b253d3-6e87-4ec9-ba08-60da34ee6875" returned: 0 in 2.183s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:36 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_txdof99pdevstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49b253d3-6e87-4ec9-ba08-60da34ee6875 {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:48:36 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Converted 112.00 MB image at 51.27 MB/s Sep 07 13:48:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49b253d3-6e87-4ec9-ba08-60da34ee6875 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:37 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49b253d3-6e87-4ec9-ba08-60da34ee6875 1G Sep 07 13:48:37 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:37 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49b253d3-6e87-4ec9-ba08-60da34ee6875 1G" returned: 0 in 0.458s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:37 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Downloaded image bdbd1541-2076-47bf-b26a-15662727e644 ((None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}])) to volume 49b253d3-6e87-4ec9-ba08-60da34ee6875 successfully. {{(pid=87571) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 13:48:37 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Temporary image bdbd1541-2076-47bf-b26a-15662727e644 for user 7dc270088b894d91aa05542bc3edb4af is deleted. {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 13:48:37 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Marking volume 49b253d3-6e87-4ec9-ba08-60da34ee6875 as bootable. {{(pid=87571) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 13:48:37 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Copying metadata from image bdbd1541-2076-47bf-b26a-15662727e644 to 49b253d3-6e87-4ec9-ba08-60da34ee6875. {{(pid=87571) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 13:48:37 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Creating volume glance metadata for volume 49b253d3-6e87-4ec9-ba08-60da34ee6875 backed by image bdbd1541-2076-47bf-b26a-15662727e644 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87571) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 13:48:37 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-edd33acd-a237-41c1-9e16-572511417203 tempest-SnapshotsActionsTest-1280823395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd 1G" returned: 0 in 0.585s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-edd33acd-a237-41c1-9e16-572511417203 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:37 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd Sep 07 13:48:37 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f650388-685b-4387-beee-e6c72c9a3fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49b253d3-6e87-4ec9-ba08-60da34ee6875', 'volume_size': 1, 'image_id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d9d2114dd14b01a04867c896fdabaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'created_at': datetime.datetime(2026, 9, 7, 11, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdbd1541-2076-47bf-b26a-15662727e644/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0925cc47-c65b-4fe9-afc8-ce1c19758b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:37 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Volume volume-49b253d3-6e87-4ec9-ba08-60da34ee6875 (49b253d3-6e87-4ec9-ba08-60da34ee6875): created successfully Sep 07 13:48:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0925cc47-c65b-4fe9-afc8-ce1c19758b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Flow 'volume_create_manager' (625307ff-0cff-4653-8b83-0b4cf4a6155c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:48:37 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-e0143ae1-8034-478c-ac81-7d634a9845a6 tempest-ServerActionsTestOtherA-611322616 None] Created volume successfully. Sep 07 13:48:37 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-edd33acd-a237-41c1-9e16-572511417203 tempest-SnapshotsActionsTest-1280823395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd" returned: 0 in 0.337s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:37 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-edd33acd-a237-41c1-9e16-572511417203 tempest-SnapshotsActionsTest-1280823395 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd is being set with open permissions: ugo+rw Sep 07 13:48:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-edd33acd-a237-41c1-9e16-572511417203 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:37 devstack sudo[94418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd Sep 07 13:48:37 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:38 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-edd33acd-a237-41c1-9e16-572511417203 tempest-SnapshotsActionsTest-1280823395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd" returned: 0 in 0.290s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-edd33acd-a237-41c1-9e16-572511417203 tempest-SnapshotsActionsTest-1280823395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.833s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:38 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-edd33acd-a237-41c1-9e16-572511417203 tempest-SnapshotsActionsTest-1280823395 None] Create snapshot completed successfully Sep 07 13:48:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-26a4dc7e-b02c-49c5-afae-f2864ef85e90 tempest-SnapshotsActionsTest-1829708489 None] Acquiring lock "cinder-f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-26a4dc7e-b02c-49c5-afae-f2864ef85e90 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-26a4dc7e-b02c-49c5-afae-f2864ef85e90 tempest-SnapshotsActionsTest-1829708489 None] Acquiring lock "cinder-quobyte-bf008b09-3bb5-4b9e-be93-5343cb4b690e" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-26a4dc7e-b02c-49c5-afae-f2864ef85e90 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-quobyte-bf008b09-3bb5-4b9e-be93-5343cb4b690e" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-26a4dc7e-b02c-49c5-afae-f2864ef85e90 tempest-SnapshotsActionsTest-1829708489 None] Acquiring lock "cinder-quobyte-f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-26a4dc7e-b02c-49c5-afae-f2864ef85e90 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-quobyte-f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-26a4dc7e-b02c-49c5-afae-f2864ef85e90 tempest-SnapshotsActionsTest-1829708489 None] Deleting offline snapshot f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd of volume bf008b09-3bb5-4b9e-be93-5343cb4b690e {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:48:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-26a4dc7e-b02c-49c5-afae-f2864ef85e90 tempest-SnapshotsActionsTest-1829708489 None] snapshot_file for this snap is: volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:48:38 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c32cdf9-fb68-4e3a-8049-fa3a8d82f1ee]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-26a4dc7e-b02c-49c5-afae-f2864ef85e90 tempest-SnapshotsActionsTest-1829708489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:38 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd Sep 07 13:48:38 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:39 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-26a4dc7e-b02c-49c5-afae-f2864ef85e90 tempest-SnapshotsActionsTest-1829708489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd" returned: 0 in 0.556s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-26a4dc7e-b02c-49c5-afae-f2864ef85e90 tempest-SnapshotsActionsTest-1829708489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:48:39 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76fc6b0-e30f-4690-a97b-b1a75c08614c]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-26a4dc7e-b02c-49c5-afae-f2864ef85e90 tempest-SnapshotsActionsTest-1829708489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:39 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d Sep 07 13:48:39 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:39 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-26a4dc7e-b02c-49c5-afae-f2864ef85e90 tempest-SnapshotsActionsTest-1829708489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d" returned: 0 in 0.427s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-26a4dc7e-b02c-49c5-afae-f2864ef85e90 tempest-SnapshotsActionsTest-1829708489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:48:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-26a4dc7e-b02c-49c5-afae-f2864ef85e90 tempest-SnapshotsActionsTest-1829708489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:39 devstack sudo[94432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd Sep 07 13:48:39 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:40 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-26a4dc7e-b02c-49c5-afae-f2864ef85e90 tempest-SnapshotsActionsTest-1829708489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd" returned: 0 in 0.470s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-26a4dc7e-b02c-49c5-afae-f2864ef85e90 tempest-SnapshotsActionsTest-1829708489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:40 devstack sudo[94438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd Sep 07 13:48:40 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:40 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-26a4dc7e-b02c-49c5-afae-f2864ef85e90 tempest-SnapshotsActionsTest-1829708489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd" returned: 0 in 0.291s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:40 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-26a4dc7e-b02c-49c5-afae-f2864ef85e90 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-quobyte-f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd" released by "_delete_snapshot" :: held 1.885s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:40 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-26a4dc7e-b02c-49c5-afae-f2864ef85e90 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-quobyte-bf008b09-3bb5-4b9e-be93-5343cb4b690e" released by "delete_snapshot" :: held 1.917s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:40 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-26a4dc7e-b02c-49c5-afae-f2864ef85e90 tempest-SnapshotsActionsTest-1829708489 None] Created reservations ['39c26933-8409-4bd9-8745-2a7aaaf4491c', '3ba81041-c3b1-4f5a-9416-dfc20b1c7a92', 'dbbcfc9e-91ad-4c23-9a69-af926eca8a9b', '06c933c3-c4e6-42a6-87d5-76e42ec8b381'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:40 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-26a4dc7e-b02c-49c5-afae-f2864ef85e90 tempest-SnapshotsActionsTest-1829708489 None] Delete snapshot completed successfully. Sep 07 13:48:40 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-26a4dc7e-b02c-49c5-afae-f2864ef85e90 tempest-SnapshotsActionsTest-1829708489 None] Lock "cinder-f8aa1258-f898-48fc-b9d5-ebe43fc9b9dd-delete_snapshot" released by "delete_snapshot" :: held 2.156s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fc9b0fea-4081-45f5-978a-72bcb47134d3 tempest-SnapshotsActionsTest-1280823395 None] Acquiring lock "cinder-7b364960-9335-4cd2-817a-1173dc3c909d-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fc9b0fea-4081-45f5-978a-72bcb47134d3 tempest-SnapshotsActionsTest-1280823395 None] Lock "cinder-7b364960-9335-4cd2-817a-1173dc3c909d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fc9b0fea-4081-45f5-978a-72bcb47134d3 tempest-SnapshotsActionsTest-1280823395 None] Acquiring lock "cinder-quobyte-bf008b09-3bb5-4b9e-be93-5343cb4b690e" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fc9b0fea-4081-45f5-978a-72bcb47134d3 tempest-SnapshotsActionsTest-1280823395 None] Lock "cinder-quobyte-bf008b09-3bb5-4b9e-be93-5343cb4b690e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fc9b0fea-4081-45f5-978a-72bcb47134d3 tempest-SnapshotsActionsTest-1280823395 None] Acquiring lock "cinder-quobyte-7b364960-9335-4cd2-817a-1173dc3c909d" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fc9b0fea-4081-45f5-978a-72bcb47134d3 tempest-SnapshotsActionsTest-1280823395 None] Lock "cinder-quobyte-7b364960-9335-4cd2-817a-1173dc3c909d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:42 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-fc9b0fea-4081-45f5-978a-72bcb47134d3 tempest-SnapshotsActionsTest-1280823395 None] Deleting offline snapshot 7b364960-9335-4cd2-817a-1173dc3c909d of volume bf008b09-3bb5-4b9e-be93-5343cb4b690e {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:48:42 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-fc9b0fea-4081-45f5-978a-72bcb47134d3 tempest-SnapshotsActionsTest-1280823395 None] snapshot_file for this snap is: volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:48:42 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ae9037-1242-4b64-8401-04167d683634]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fc9b0fea-4081-45f5-978a-72bcb47134d3 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:42 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d Sep 07 13:48:42 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:43 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fc9b0fea-4081-45f5-978a-72bcb47134d3 tempest-SnapshotsActionsTest-1280823395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d" returned: 0 in 0.586s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-fc9b0fea-4081-45f5-978a-72bcb47134d3 tempest-SnapshotsActionsTest-1280823395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:48:43 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc2dcf7-1dae-419c-b08a-f57b8f60bf02]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fc9b0fea-4081-45f5-978a-72bcb47134d3 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:43 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e Sep 07 13:48:43 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:43 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fc9b0fea-4081-45f5-978a-72bcb47134d3 tempest-SnapshotsActionsTest-1280823395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e" returned: 0 in 0.549s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fc9b0fea-4081-45f5-978a-72bcb47134d3 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:43 devstack sudo[94454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d Sep 07 13:48:43 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:44 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fc9b0fea-4081-45f5-978a-72bcb47134d3 tempest-SnapshotsActionsTest-1280823395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d" returned: 0 in 0.466s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fc9b0fea-4081-45f5-978a-72bcb47134d3 tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:44 devstack sudo[94460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d Sep 07 13:48:44 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:44 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fc9b0fea-4081-45f5-978a-72bcb47134d3 tempest-SnapshotsActionsTest-1280823395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e.7b364960-9335-4cd2-817a-1173dc3c909d" returned: 0 in 0.306s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fc9b0fea-4081-45f5-978a-72bcb47134d3 tempest-SnapshotsActionsTest-1280823395 None] Lock "cinder-quobyte-7b364960-9335-4cd2-817a-1173dc3c909d" released by "_delete_snapshot" :: held 2.095s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fc9b0fea-4081-45f5-978a-72bcb47134d3 tempest-SnapshotsActionsTest-1280823395 None] Lock "cinder-quobyte-bf008b09-3bb5-4b9e-be93-5343cb4b690e" released by "delete_snapshot" :: held 2.122s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:44 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-fc9b0fea-4081-45f5-978a-72bcb47134d3 tempest-SnapshotsActionsTest-1280823395 None] Created reservations ['2836ea5b-390f-46a6-a355-9842872bb990', '83b21a16-b2d3-4286-b9ed-4beb036ae49e', '4c9d0c94-510b-4b12-915f-633bb7141fd5', '86246c15-c06d-4ae7-8784-981ff4b4cdf2'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:44 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-fc9b0fea-4081-45f5-978a-72bcb47134d3 tempest-SnapshotsActionsTest-1280823395 None] Delete snapshot completed successfully. Sep 07 13:48:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fc9b0fea-4081-45f5-978a-72bcb47134d3 tempest-SnapshotsActionsTest-1280823395 None] Lock "cinder-7b364960-9335-4cd2-817a-1173dc3c909d-delete_snapshot" released by "delete_snapshot" :: held 2.362s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:45 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-867d41ba-e21b-498e-b784-c9ae0e6704db tempest-SnapshotsActionsTest-1280823395 None] Acquiring lock "cinder-bf008b09-3bb5-4b9e-be93-5343cb4b690e-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:46 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-867d41ba-e21b-498e-b784-c9ae0e6704db tempest-SnapshotsActionsTest-1280823395 None] Lock "cinder-bf008b09-3bb5-4b9e-be93-5343cb4b690e-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:46 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-867d41ba-e21b-498e-b784-c9ae0e6704db tempest-SnapshotsActionsTest-1280823395 None] Acquiring lock "cinder-quobyte-bf008b09-3bb5-4b9e-be93-5343cb4b690e" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:46 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-867d41ba-e21b-498e-b784-c9ae0e6704db tempest-SnapshotsActionsTest-1280823395 None] Lock "cinder-quobyte-bf008b09-3bb5-4b9e-be93-5343cb4b690e" acquired by "delete_volume" :: waited 0.024s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:46 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cb1436-9d55-4302-957a-a7590b95b08e]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-867d41ba-e21b-498e-b784-c9ae0e6704db tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-769eca9f-d9d2-45aa-b497-e875d251ce4d req-6c2b0160-5aba-48c0-b83a-22968ad3ffa5 tempest-ServerActionsTestOtherA-611322616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-769eca9f-d9d2-45aa-b497-e875d251ce4d req-6c2b0160-5aba-48c0-b83a-22968ad3ffa5 tempest-ServerActionsTestOtherA-611322616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-769eca9f-d9d2-45aa-b497-e875d251ce4d req-6c2b0160-5aba-48c0-b83a-22968ad3ffa5 tempest-ServerActionsTestOtherA-611322616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:46 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-769eca9f-d9d2-45aa-b497-e875d251ce4d req-6c2b0160-5aba-48c0-b83a-22968ad3ffa5 tempest-ServerActionsTestOtherA-611322616 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285', 'name': 'volume-49b253d3-6e87-4ec9-ba08-60da34ee6875', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a0bf6665-f9c4-469d-806b-9761751f5465', 'enforce_multipath': True} {{(pid=87571) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:48:46 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-769eca9f-d9d2-45aa-b497-e875d251ce4d req-6c2b0160-5aba-48c0-b83a-22968ad3ffa5 tempest-ServerActionsTestOtherA-611322616 None] attachment_update completed successfully. Sep 07 13:48:46 devstack sudo[94472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e Sep 07 13:48:46 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:46 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-867d41ba-e21b-498e-b784-c9ae0e6704db tempest-SnapshotsActionsTest-1280823395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e" returned: 0 in 0.637s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-867d41ba-e21b-498e-b784-c9ae0e6704db tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:46 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e Sep 07 13:48:46 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:47 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-867d41ba-e21b-498e-b784-c9ae0e6704db tempest-SnapshotsActionsTest-1280823395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf008b09-3bb5-4b9e-be93-5343cb4b690e" returned: 0 in 0.390s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-867d41ba-e21b-498e-b784-c9ae0e6704db tempest-SnapshotsActionsTest-1280823395 None] Lock "cinder-quobyte-bf008b09-3bb5-4b9e-be93-5343cb4b690e" released by "delete_volume" :: held 1.125s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:47 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-867d41ba-e21b-498e-b784-c9ae0e6704db tempest-SnapshotsActionsTest-1280823395 None] Created reservations ['926e1860-a652-4161-8d45-bdc97433c029', 'deaabe3f-3e58-40d5-ad69-690692759cb4', 'fe2574d6-61ff-411f-bf19-0f2ff3e9408b', '1e77651d-da8a-446f-8d81-cf73b1543afe'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-867d41ba-e21b-498e-b784-c9ae0e6704db tempest-SnapshotsActionsTest-1280823395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-867d41ba-e21b-498e-b784-c9ae0e6704db tempest-SnapshotsActionsTest-1280823395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-867d41ba-e21b-498e-b784-c9ae0e6704db tempest-SnapshotsActionsTest-1280823395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-867d41ba-e21b-498e-b784-c9ae0e6704db tempest-SnapshotsActionsTest-1280823395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-867d41ba-e21b-498e-b784-c9ae0e6704db tempest-SnapshotsActionsTest-1280823395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-867d41ba-e21b-498e-b784-c9ae0e6704db tempest-SnapshotsActionsTest-1280823395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:47 devstack sudo[94491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:48:47 devstack sudo[94491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:47 devstack sudo[94491]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-867d41ba-e21b-498e-b784-c9ae0e6704db tempest-SnapshotsActionsTest-1280823395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.359s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:47 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-867d41ba-e21b-498e-b784-c9ae0e6704db tempest-SnapshotsActionsTest-1280823395 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:48:47 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-867d41ba-e21b-498e-b784-c9ae0e6704db tempest-SnapshotsActionsTest-1280823395 None] Deleted volume successfully. Sep 07 13:48:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-867d41ba-e21b-498e-b784-c9ae0e6704db tempest-SnapshotsActionsTest-1280823395 None] Lock "cinder-bf008b09-3bb5-4b9e-be93-5343cb4b690e-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:59 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=52,cinder:UPDATE=53,cinder:DELETE=1,cinder:INSERT=21 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:48:59 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=65,cinder:INSERT=19,cinder:UPDATE=59,cinder:DELETE=3 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:49:10 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-edc226d9-c3f0-4ca2-81c5-0bd3b987881d req-8ca8aa1e-d509-4a58-a3d0-2a8ac14559ff tempest-ServerActionsTestOtherA-611322616 None] Terminate volume connection completed successfully. Sep 07 13:49:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-edc226d9-c3f0-4ca2-81c5-0bd3b987881d req-8ca8aa1e-d509-4a58-a3d0-2a8ac14559ff tempest-ServerActionsTestOtherA-611322616 None] Deleting attachment a0bf6665-f9c4-469d-806b-9761751f5465. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:49:10 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:49:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Flow 'volume_create_manager' (879952c8-7725-439c-afda-6213ca3d4ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec02c08b-672c-49b2-a926-6ba518b665b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec02c08b-672c-49b2-a926-6ba518b665b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1343993638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=299c6763-9ccb-4816-86d0-f2257666e1af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abce9ad60f9842b4bd527b0467e0cc71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:11Z,use_quota=True,user_id='9cfbdd6132c8494099b351217cdcc8fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22352bda-9bc9-485a-8b97-297a627927a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22352bda-9bc9-485a-8b97-297a627927a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae1ec06-75df-4be5-a129-401c3b963e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae1ec06-75df-4be5-a129-401c3b963e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '299c6763-9ccb-4816-86d0-f2257666e1af', 'volume_name': 'volume-299c6763-9ccb-4816-86d0-f2257666e1af', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (148aa7e5-4d60-421a-a053-2aa5f0e2d94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (148aa7e5-4d60-421a-a053-2aa5f0e2d94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2076dce6-7e3a-4390-9732-5cf1fdfdbe3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:10 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Volume 299c6763-9ccb-4816-86d0-f2257666e1af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-299c6763-9ccb-4816-86d0-f2257666e1af', 'volume_size': 1} Sep 07 13:49:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1343993638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=299c6763-9ccb-4816-86d0-f2257666e1af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abce9ad60f9842b4bd527b0467e0cc71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:11Z,use_quota=True,user_id='9cfbdd6132c8494099b351217cdcc8fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:49:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Creating volume 299c6763-9ccb-4816-86d0-f2257666e1af {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:49:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:49:10 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:49:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-299c6763-9ccb-4816-86d0-f2257666e1af 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:10 devstack sudo[95034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-299c6763-9ccb-4816-86d0-f2257666e1af 1073741824 Sep 07 13:49:10 devstack sudo[95034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:11 devstack sudo[95034]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-299c6763-9ccb-4816-86d0-f2257666e1af 1073741824" returned: 0 in 0.509s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-299c6763-9ccb-4816-86d0-f2257666e1af {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:11 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-299c6763-9ccb-4816-86d0-f2257666e1af Sep 07 13:49:11 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:11 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-299c6763-9ccb-4816-86d0-f2257666e1af" returned: 0 in 0.363s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:11 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:49:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2076dce6-7e3a-4390-9732-5cf1fdfdbe3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-299c6763-9ccb-4816-86d0-f2257666e1af', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f280fb-c05b-44c1-af52-a090b27a0383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:11 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Volume volume-299c6763-9ccb-4816-86d0-f2257666e1af (299c6763-9ccb-4816-86d0-f2257666e1af): created successfully Sep 07 13:49:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f280fb-c05b-44c1-af52-a090b27a0383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Flow 'volume_create_manager' (879952c8-7725-439c-afda-6213ca3d4ed4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:11 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-ed103e37-97c2-4c65-abae-91abdf4f2c0b tempest-VolumeQuotasNegativeTestJSON-296587265 None] Created volume successfully. Sep 07 13:49:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-edc226d9-c3f0-4ca2-81c5-0bd3b987881d req-885553a7-2ed9-4550-bded-ebcd6da35105 tempest-ServerActionsTestOtherA-611322616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-edc226d9-c3f0-4ca2-81c5-0bd3b987881d req-885553a7-2ed9-4550-bded-ebcd6da35105 tempest-ServerActionsTestOtherA-611322616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-edc226d9-c3f0-4ca2-81c5-0bd3b987881d req-885553a7-2ed9-4550-bded-ebcd6da35105 tempest-ServerActionsTestOtherA-611322616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-edc226d9-c3f0-4ca2-81c5-0bd3b987881d req-885553a7-2ed9-4550-bded-ebcd6da35105 tempest-ServerActionsTestOtherA-611322616 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285', 'name': 'volume-49b253d3-6e87-4ec9-ba08-60da34ee6875', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b6390b4e-87f0-497d-bce2-d9f45d4612f7', 'enforce_multipath': True} {{(pid=87571) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:49:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9990d3e1-0c0e-4219-b62c-b0a9b25f959c tempest-VolumeQuotasNegativeTestJSON-296587265 None] Acquiring lock "cinder-299c6763-9ccb-4816-86d0-f2257666e1af-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9990d3e1-0c0e-4219-b62c-b0a9b25f959c tempest-VolumeQuotasNegativeTestJSON-296587265 None] Lock "cinder-299c6763-9ccb-4816-86d0-f2257666e1af-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:15 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-edc226d9-c3f0-4ca2-81c5-0bd3b987881d req-885553a7-2ed9-4550-bded-ebcd6da35105 tempest-ServerActionsTestOtherA-611322616 None] attachment_update completed successfully. Sep 07 13:49:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9990d3e1-0c0e-4219-b62c-b0a9b25f959c tempest-VolumeQuotasNegativeTestJSON-296587265 None] Acquiring lock "cinder-quobyte-299c6763-9ccb-4816-86d0-f2257666e1af" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9990d3e1-0c0e-4219-b62c-b0a9b25f959c tempest-VolumeQuotasNegativeTestJSON-296587265 None] Lock "cinder-quobyte-299c6763-9ccb-4816-86d0-f2257666e1af" acquired by "delete_volume" :: waited 0.027s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:15 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f2cf01-6085-483e-9d83-82752e37355c]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9990d3e1-0c0e-4219-b62c-b0a9b25f959c tempest-VolumeQuotasNegativeTestJSON-296587265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-299c6763-9ccb-4816-86d0-f2257666e1af {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:15 devstack sudo[95122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-299c6763-9ccb-4816-86d0-f2257666e1af Sep 07 13:49:15 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:15 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9990d3e1-0c0e-4219-b62c-b0a9b25f959c tempest-VolumeQuotasNegativeTestJSON-296587265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-299c6763-9ccb-4816-86d0-f2257666e1af" returned: 0 in 0.610s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9990d3e1-0c0e-4219-b62c-b0a9b25f959c tempest-VolumeQuotasNegativeTestJSON-296587265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-299c6763-9ccb-4816-86d0-f2257666e1af {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:16 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-299c6763-9ccb-4816-86d0-f2257666e1af Sep 07 13:49:16 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:16 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9990d3e1-0c0e-4219-b62c-b0a9b25f959c tempest-VolumeQuotasNegativeTestJSON-296587265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-299c6763-9ccb-4816-86d0-f2257666e1af" returned: 0 in 0.545s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:16 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9990d3e1-0c0e-4219-b62c-b0a9b25f959c tempest-VolumeQuotasNegativeTestJSON-296587265 None] Lock "cinder-quobyte-299c6763-9ccb-4816-86d0-f2257666e1af" released by "delete_volume" :: held 1.257s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:16 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-9990d3e1-0c0e-4219-b62c-b0a9b25f959c tempest-VolumeQuotasNegativeTestJSON-296587265 None] Created reservations ['81a8ddc6-b4e6-457b-8ea4-b03ddb9cd864', 'e163b1ac-2f4c-42c2-987e-376bea08abb6', 'd0913e25-749d-4fca-84da-934c92a271e2', '1ad8a411-0d3e-4027-84f7-6e1c3338922d'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9990d3e1-0c0e-4219-b62c-b0a9b25f959c tempest-VolumeQuotasNegativeTestJSON-296587265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9990d3e1-0c0e-4219-b62c-b0a9b25f959c tempest-VolumeQuotasNegativeTestJSON-296587265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9990d3e1-0c0e-4219-b62c-b0a9b25f959c tempest-VolumeQuotasNegativeTestJSON-296587265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9990d3e1-0c0e-4219-b62c-b0a9b25f959c tempest-VolumeQuotasNegativeTestJSON-296587265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9990d3e1-0c0e-4219-b62c-b0a9b25f959c tempest-VolumeQuotasNegativeTestJSON-296587265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9990d3e1-0c0e-4219-b62c-b0a9b25f959c tempest-VolumeQuotasNegativeTestJSON-296587265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:16 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:49:16 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:17 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9990d3e1-0c0e-4219-b62c-b0a9b25f959c tempest-VolumeQuotasNegativeTestJSON-296587265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.772s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:17 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-9990d3e1-0c0e-4219-b62c-b0a9b25f959c tempest-VolumeQuotasNegativeTestJSON-296587265 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:49:17 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-9990d3e1-0c0e-4219-b62c-b0a9b25f959c tempest-VolumeQuotasNegativeTestJSON-296587265 None] Deleted volume successfully. Sep 07 13:49:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9990d3e1-0c0e-4219-b62c-b0a9b25f959c tempest-VolumeQuotasNegativeTestJSON-296587265 None] Lock "cinder-299c6763-9ccb-4816-86d0-f2257666e1af-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:17 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:49:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Flow 'volume_create_manager' (1d4efb58-2934-474e-b0a2-1b582b2b6d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (087fdc81-5bed-460d-bfde-e85de8910a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (087fdc81-5bed-460d-bfde-e85de8910a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1355409996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5575594-b48c-4c6a-9559-b9e67d3a37cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820bd2c21e184e34b03df3bdca253419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:18Z,use_quota=True,user_id='41a9580f52b14925b32928cfe2a02728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de83972-4488-41aa-90f0-584735bff7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de83972-4488-41aa-90f0-584735bff7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1d18d9-568b-45b8-bef5-db89c47822e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1d18d9-568b-45b8-bef5-db89c47822e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5575594-b48c-4c6a-9559-b9e67d3a37cd', 'volume_name': 'volume-b5575594-b48c-4c6a-9559-b9e67d3a37cd', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8771390c-71fd-4cca-92cb-470435cc13b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8771390c-71fd-4cca-92cb-470435cc13b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62289e12-48dc-42a1-9b97-c2cef2e765a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:18 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Volume b5575594-b48c-4c6a-9559-b9e67d3a37cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5575594-b48c-4c6a-9559-b9e67d3a37cd', 'volume_size': 1} Sep 07 13:49:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1355409996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5575594-b48c-4c6a-9559-b9e67d3a37cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820bd2c21e184e34b03df3bdca253419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:18Z,use_quota=True,user_id='41a9580f52b14925b32928cfe2a02728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:49:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Creating volume b5575594-b48c-4c6a-9559-b9e67d3a37cd {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:49:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:49:18 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:49:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b5575594-b48c-4c6a-9559-b9e67d3a37cd 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:18 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b5575594-b48c-4c6a-9559-b9e67d3a37cd 1073741824 Sep 07 13:49:18 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:18 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b5575594-b48c-4c6a-9559-b9e67d3a37cd 1073741824" returned: 0 in 0.777s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b5575594-b48c-4c6a-9559-b9e67d3a37cd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:19 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b5575594-b48c-4c6a-9559-b9e67d3a37cd Sep 07 13:49:19 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:19 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b5575594-b48c-4c6a-9559-b9e67d3a37cd" returned: 0 in 0.550s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:19 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:49:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:19 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62289e12-48dc-42a1-9b97-c2cef2e765a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5575594-b48c-4c6a-9559-b9e67d3a37cd', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:19 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a86f80-1869-4a36-99f0-b9dc4ee93c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:19 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Volume volume-b5575594-b48c-4c6a-9559-b9e67d3a37cd (b5575594-b48c-4c6a-9559-b9e67d3a37cd): created successfully Sep 07 13:49:19 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a86f80-1869-4a36-99f0-b9dc4ee93c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:19 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Flow 'volume_create_manager' (1d4efb58-2934-474e-b0a2-1b582b2b6d55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:19 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-f0f8d3d5-e531-4884-9a65-e6e3b30704b0 tempest-VolumesActionsTest-1399979072 None] Created volume successfully. Sep 07 13:49:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2acb3875-5ca1-4e7b-9161-06a5ee361a81 tempest-VolumesActionsTest-1399979072 None] Acquiring lock "cinder-b5575594-b48c-4c6a-9559-b9e67d3a37cd" by "attach_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2acb3875-5ca1-4e7b-9161-06a5ee361a81 tempest-VolumesActionsTest-1399979072 None] Lock "cinder-b5575594-b48c-4c6a-9559-b9e67d3a37cd" acquired by "attach_volume" :: waited 0.039s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:20 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-2acb3875-5ca1-4e7b-9161-06a5ee361a81 tempest-VolumesActionsTest-1399979072 None] Attaching volume b5575594-b48c-4c6a-9559-b9e67d3a37cd to instance b0c1db67-3490-4d46-aabf-9f63721d093d at mountpoint /dev/vdb on host None. Sep 07 13:49:20 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-2acb3875-5ca1-4e7b-9161-06a5ee361a81 tempest-VolumesActionsTest-1399979072 None] Attach volume completed successfully. Sep 07 13:49:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2acb3875-5ca1-4e7b-9161-06a5ee361a81 tempest-VolumesActionsTest-1399979072 None] Lock "cinder-b5575594-b48c-4c6a-9559-b9e67d3a37cd" released by "attach_volume" :: held 0.258s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:21 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-d4f8bba0-3a3b-4aaa-8e05-be417afef641 tempest-VolumesActionsTest-2090425500 None] Terminate volume connection completed successfully. Sep 07 13:49:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d4f8bba0-3a3b-4aaa-8e05-be417afef641 tempest-VolumesActionsTest-2090425500 None] Acquiring lock "cinder-b5575594-b48c-4c6a-9559-b9e67d3a37cd-detach_volume" by "detach_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d4f8bba0-3a3b-4aaa-8e05-be417afef641 tempest-VolumesActionsTest-2090425500 None] Lock "cinder-b5575594-b48c-4c6a-9559-b9e67d3a37cd-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:21 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-d4f8bba0-3a3b-4aaa-8e05-be417afef641 tempest-VolumesActionsTest-2090425500 None] Detaching volume b5575594-b48c-4c6a-9559-b9e67d3a37cd from instance b0c1db67-3490-4d46-aabf-9f63721d093d. Sep 07 13:49:21 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:49:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Flow 'volume_create_manager' (c6c3b3c3-ead0-47ee-9693-ebe1825249cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2f33ba-8119-4d67-882b-57aefbb49504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2f33ba-8119-4d67-882b-57aefbb49504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-118532943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec8a4854-aef3-49f6-802f-fd7a5d887b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c99db587890465db53e87d742101c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:22Z,use_quota=True,user_id='f8e524ee076547fda9e87ba001c5b0cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (047a32e6-f9c5-4b1c-b00d-39f95fbecb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (047a32e6-f9c5-4b1c-b00d-39f95fbecb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f1c242-1ab8-4ed9-8843-ae62975d4e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f1c242-1ab8-4ed9-8843-ae62975d4e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec8a4854-aef3-49f6-802f-fd7a5d887b4c', 'volume_name': 'volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138dc0ab-e0ca-427c-a05a-c7a0934079a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138dc0ab-e0ca-427c-a05a-c7a0934079a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84b0c9c-50c4-496d-b3bd-f12f4a636425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:22 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Volume ec8a4854-aef3-49f6-802f-fd7a5d887b4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c', 'volume_size': 1} Sep 07 13:49:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-118532943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec8a4854-aef3-49f6-802f-fd7a5d887b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c99db587890465db53e87d742101c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:22Z,use_quota=True,user_id='f8e524ee076547fda9e87ba001c5b0cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:49:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Creating volume ec8a4854-aef3-49f6-802f-fd7a5d887b4c {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:49:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:49:22 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:49:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:22 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-d4f8bba0-3a3b-4aaa-8e05-be417afef641 tempest-VolumesActionsTest-2090425500 None] Detach volume completed successfully. Sep 07 13:49:22 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c 1073741824 Sep 07 13:49:22 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:22 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d4f8bba0-3a3b-4aaa-8e05-be417afef641 tempest-VolumesActionsTest-2090425500 None] Lock "cinder-b5575594-b48c-4c6a-9559-b9e67d3a37cd-detach_volume" released by "detach_volume" :: held 0.353s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:22 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b185dde7-acbb-4c77-bea3-cf88d78c88eb tempest-VolumesActionsTest-1399979072 None] Acquiring lock "cinder-b5575594-b48c-4c6a-9559-b9e67d3a37cd-detach_volume" by "detach_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:22 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b185dde7-acbb-4c77-bea3-cf88d78c88eb tempest-VolumesActionsTest-1399979072 None] Lock "cinder-b5575594-b48c-4c6a-9559-b9e67d3a37cd-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:22 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-b185dde7-acbb-4c77-bea3-cf88d78c88eb tempest-VolumesActionsTest-1399979072 None] Volume detach called, but volume not attached. Sep 07 13:49:22 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b185dde7-acbb-4c77-bea3-cf88d78c88eb tempest-VolumesActionsTest-1399979072 None] Lock "cinder-b5575594-b48c-4c6a-9559-b9e67d3a37cd-detach_volume" released by "detach_volume" :: held 0.064s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1f530d60-3eaf-4ec6-aa16-4dabe0c78faf tempest-VolumesActionsTest-1399979072 None] Acquiring lock "cinder-b5575594-b48c-4c6a-9559-b9e67d3a37cd-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1f530d60-3eaf-4ec6-aa16-4dabe0c78faf tempest-VolumesActionsTest-1399979072 None] Lock "cinder-b5575594-b48c-4c6a-9559-b9e67d3a37cd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1f530d60-3eaf-4ec6-aa16-4dabe0c78faf tempest-VolumesActionsTest-1399979072 None] Acquiring lock "cinder-quobyte-b5575594-b48c-4c6a-9559-b9e67d3a37cd" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1f530d60-3eaf-4ec6-aa16-4dabe0c78faf tempest-VolumesActionsTest-1399979072 None] Lock "cinder-quobyte-b5575594-b48c-4c6a-9559-b9e67d3a37cd" acquired by "delete_volume" :: waited 0.047s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:23 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9015382-935e-4191-9903-5c3d59b9c5cf]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1f530d60-3eaf-4ec6-aa16-4dabe0c78faf tempest-VolumesActionsTest-1399979072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b5575594-b48c-4c6a-9559-b9e67d3a37cd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:23 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c 1073741824" returned: 0 in 1.431s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:23 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b5575594-b48c-4c6a-9559-b9e67d3a37cd Sep 07 13:49:23 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:23 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c Sep 07 13:49:23 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:24 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c" returned: 0 in 0.546s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] <== create_volume: return (2146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:49:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.149s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:24 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1f530d60-3eaf-4ec6-aa16-4dabe0c78faf tempest-VolumesActionsTest-1399979072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b5575594-b48c-4c6a-9559-b9e67d3a37cd" returned: 0 in 0.799s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1f530d60-3eaf-4ec6-aa16-4dabe0c78faf tempest-VolumesActionsTest-1399979072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b5575594-b48c-4c6a-9559-b9e67d3a37cd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84b0c9c-50c4-496d-b3bd-f12f4a636425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171cb60c-2bf9-4dd3-977d-bed44aee0a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:24 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b5575594-b48c-4c6a-9559-b9e67d3a37cd Sep 07 13:49:24 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:24 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Volume volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c (ec8a4854-aef3-49f6-802f-fd7a5d887b4c): created successfully Sep 07 13:49:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171cb60c-2bf9-4dd3-977d-bed44aee0a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Flow 'volume_create_manager' (c6c3b3c3-ead0-47ee-9693-ebe1825249cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:24 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-1780a813-b86e-42df-bf59-41fe258b7640 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Created volume successfully. Sep 07 13:49:25 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1f530d60-3eaf-4ec6-aa16-4dabe0c78faf tempest-VolumesActionsTest-1399979072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b5575594-b48c-4c6a-9559-b9e67d3a37cd" returned: 0 in 0.750s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1f530d60-3eaf-4ec6-aa16-4dabe0c78faf tempest-VolumesActionsTest-1399979072 None] Lock "cinder-quobyte-b5575594-b48c-4c6a-9559-b9e67d3a37cd" released by "delete_volume" :: held 1.674s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:25 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-1f530d60-3eaf-4ec6-aa16-4dabe0c78faf tempest-VolumesActionsTest-1399979072 None] Created reservations ['e84377ce-de71-4b66-a532-6f37400e0baf', '2b1abedd-4578-4a62-be60-578f3ea152ee', '492fc29a-7312-45b0-a58c-e359a767f3e1', '2fd99a75-dbe2-4a43-a02d-052382a3a1dc'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1f530d60-3eaf-4ec6-aa16-4dabe0c78faf tempest-VolumesActionsTest-1399979072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1f530d60-3eaf-4ec6-aa16-4dabe0c78faf tempest-VolumesActionsTest-1399979072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1f530d60-3eaf-4ec6-aa16-4dabe0c78faf tempest-VolumesActionsTest-1399979072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1f530d60-3eaf-4ec6-aa16-4dabe0c78faf tempest-VolumesActionsTest-1399979072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1f530d60-3eaf-4ec6-aa16-4dabe0c78faf tempest-VolumesActionsTest-1399979072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1f530d60-3eaf-4ec6-aa16-4dabe0c78faf tempest-VolumesActionsTest-1399979072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:25 devstack sudo[95589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:49:25 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:25 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1f530d60-3eaf-4ec6-aa16-4dabe0c78faf tempest-VolumesActionsTest-1399979072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.668s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:25 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-1f530d60-3eaf-4ec6-aa16-4dabe0c78faf tempest-VolumesActionsTest-1399979072 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:49:25 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-1f530d60-3eaf-4ec6-aa16-4dabe0c78faf tempest-VolumesActionsTest-1399979072 None] Deleted volume successfully. Sep 07 13:49:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1f530d60-3eaf-4ec6-aa16-4dabe0c78faf tempest-VolumesActionsTest-1399979072 None] Lock "cinder-b5575594-b48c-4c6a-9559-b9e67d3a37cd-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-358a313c-02aa-4921-aa1e-18a7a466c68d tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-358a313c-02aa-4921-aa1e-18a7a466c68d tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:26 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-358a313c-02aa-4921-aa1e-18a7a466c68d tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Creating offline snapshot 55e7f827-025b-4032-8db3-85ed8eaa079b of volume ec8a4854-aef3-49f6-802f-fd7a5d887b4c {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:49:26 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[853a1121-e3df-4307-8ba2-3983e0120ade]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-358a313c-02aa-4921-aa1e-18a7a466c68d tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:26 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c Sep 07 13:49:26 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:27 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-358a313c-02aa-4921-aa1e-18a7a466c68d tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c" returned: 0 in 0.892s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-358a313c-02aa-4921-aa1e-18a7a466c68d tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.55e7f827-025b-4032-8db3-85ed8eaa079b 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:27 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.55e7f827-025b-4032-8db3-85ed8eaa079b 1G Sep 07 13:49:27 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:27 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-358a313c-02aa-4921-aa1e-18a7a466c68d tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.55e7f827-025b-4032-8db3-85ed8eaa079b 1G" returned: 0 in 0.614s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-358a313c-02aa-4921-aa1e-18a7a466c68d tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.55e7f827-025b-4032-8db3-85ed8eaa079b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:27 devstack sudo[95628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.55e7f827-025b-4032-8db3-85ed8eaa079b Sep 07 13:49:27 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:49:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:28 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-358a313c-02aa-4921-aa1e-18a7a466c68d tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.55e7f827-025b-4032-8db3-85ed8eaa079b" returned: 0 in 0.437s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:28 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-358a313c-02aa-4921-aa1e-18a7a466c68d tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.55e7f827-025b-4032-8db3-85ed8eaa079b is being set with open permissions: ugo+rw Sep 07 13:49:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-358a313c-02aa-4921-aa1e-18a7a466c68d tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.55e7f827-025b-4032-8db3-85ed8eaa079b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:28 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:49:28 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:28 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.55e7f827-025b-4032-8db3-85ed8eaa079b Sep 07 13:49:28 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:28 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-358a313c-02aa-4921-aa1e-18a7a466c68d tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.55e7f827-025b-4032-8db3-85ed8eaa079b" returned: 0 in 0.371s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-358a313c-02aa-4921-aa1e-18a7a466c68d tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:28 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.521s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:28 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.info Sep 07 13:49:28 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:49:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager._thread_info {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:49:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread count: 28 {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:49:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread info: [<_MainThread(MainThread, started 132147689414784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:49:29 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-358a313c-02aa-4921-aa1e-18a7a466c68d tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.info" returned: 0 in 0.278s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:29 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-358a313c-02aa-4921-aa1e-18a7a466c68d tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.info is being set with open permissions: ugo+rw Sep 07 13:49:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-358a313c-02aa-4921-aa1e-18a7a466c68d tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:29 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.info Sep 07 13:49:29 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:29 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-358a313c-02aa-4921-aa1e-18a7a466c68d tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.info" returned: 0 in 0.306s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-358a313c-02aa-4921-aa1e-18a7a466c68d tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.070s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:29 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-358a313c-02aa-4921-aa1e-18a7a466c68d tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Create snapshot completed successfully Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Flow 'volume_create_manager' (2fe38fb4-e6d2-48fe-bc44-769b1549ba5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2afaee-ce1c-469a-bdad-fb9fd9586aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2afaee-ce1c-469a-bdad-fb9fd9586aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-420290746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80aedd00-c11a-4b7f-a92f-51bbeccd0e40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820bd2c21e184e34b03df3bdca253419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:30Z,use_quota=True,user_id='41a9580f52b14925b32928cfe2a02728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17c9922-2192-403d-8520-708f8ce536f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17c9922-2192-403d-8520-708f8ce536f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84241583-67e7-44b4-8cfa-3d549058ba67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84241583-67e7-44b4-8cfa-3d549058ba67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80aedd00-c11a-4b7f-a92f-51bbeccd0e40', 'volume_name': 'volume-80aedd00-c11a-4b7f-a92f-51bbeccd0e40', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205396d4-c803-4e41-bc08-ba7df94aac1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205396d4-c803-4e41-bc08-ba7df94aac1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b511fb-f52f-4055-9c8a-3979b66ac09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:30 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Volume 80aedd00-c11a-4b7f-a92f-51bbeccd0e40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80aedd00-c11a-4b7f-a92f-51bbeccd0e40', 'volume_size': 1} Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-420290746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80aedd00-c11a-4b7f-a92f-51bbeccd0e40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820bd2c21e184e34b03df3bdca253419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:30Z,use_quota=True,user_id='41a9580f52b14925b32928cfe2a02728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Creating volume 80aedd00-c11a-4b7f-a92f-51bbeccd0e40 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:49:30 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-80aedd00-c11a-4b7f-a92f-51bbeccd0e40 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:30 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-80aedd00-c11a-4b7f-a92f-51bbeccd0e40 1073741824 Sep 07 13:49:30 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:30 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-80aedd00-c11a-4b7f-a92f-51bbeccd0e40 1073741824" returned: 0 in 0.570s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-80aedd00-c11a-4b7f-a92f-51bbeccd0e40 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fbf33761-a54a-46cc-8ed6-8141745f3a9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Acquiring lock "cinder-55e7f827-025b-4032-8db3-85ed8eaa079b-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fbf33761-a54a-46cc-8ed6-8141745f3a9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Lock "cinder-55e7f827-025b-4032-8db3-85ed8eaa079b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fbf33761-a54a-46cc-8ed6-8141745f3a9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Acquiring lock "cinder-quobyte-ec8a4854-aef3-49f6-802f-fd7a5d887b4c" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:31 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-80aedd00-c11a-4b7f-a92f-51bbeccd0e40 Sep 07 13:49:31 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fbf33761-a54a-46cc-8ed6-8141745f3a9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Lock "cinder-quobyte-ec8a4854-aef3-49f6-802f-fd7a5d887b4c" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fbf33761-a54a-46cc-8ed6-8141745f3a9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Acquiring lock "cinder-quobyte-55e7f827-025b-4032-8db3-85ed8eaa079b" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fbf33761-a54a-46cc-8ed6-8141745f3a9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Lock "cinder-quobyte-55e7f827-025b-4032-8db3-85ed8eaa079b" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-fbf33761-a54a-46cc-8ed6-8141745f3a9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Deleting offline snapshot 55e7f827-025b-4032-8db3-85ed8eaa079b of volume ec8a4854-aef3-49f6-802f-fd7a5d887b4c {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-fbf33761-a54a-46cc-8ed6-8141745f3a9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] snapshot_file for this snap is: volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.55e7f827-025b-4032-8db3-85ed8eaa079b {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5baf94-290e-4394-be0e-6ca3ad7cafb3]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fbf33761-a54a-46cc-8ed6-8141745f3a9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.55e7f827-025b-4032-8db3-85ed8eaa079b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:31 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.55e7f827-025b-4032-8db3-85ed8eaa079b Sep 07 13:49:31 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:31 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-80aedd00-c11a-4b7f-a92f-51bbeccd0e40" returned: 0 in 0.485s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b511fb-f52f-4055-9c8a-3979b66ac09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80aedd00-c11a-4b7f-a92f-51bbeccd0e40', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (351052bb-00ac-46c0-80c8-64d6e51ce7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:31 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Volume volume-80aedd00-c11a-4b7f-a92f-51bbeccd0e40 (80aedd00-c11a-4b7f-a92f-51bbeccd0e40): created successfully Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (351052bb-00ac-46c0-80c8-64d6e51ce7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Flow 'volume_create_manager' (2fe38fb4-e6d2-48fe-bc44-769b1549ba5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Flow 'volume_create_manager' (ab6a8f41-2082-435b-999c-ded9eabd7b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1341f8eb-5b86-4741-9482-36585c89e27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:31 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-76af9082-dfb9-4fd3-ba84-86f4f69e5bb6 tempest-VolumesActionsTest-1399979072 None] Created volume successfully. Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1341f8eb-5b86-4741-9482-36585c89e27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-782767108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d18a22-354e-43cd-a4e5-eef13cb66d1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6046403e605c41469ec9ba4c418a14af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:31Z,use_quota=True,user_id='054f1b8d538a4aa6977ad37856a34c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16edbe44-5cd6-4075-84fd-1f703178bb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16edbe44-5cd6-4075-84fd-1f703178bb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (516d5376-ab90-4ad8-b4d2-15c18231942f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (516d5376-ab90-4ad8-b4d2-15c18231942f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d18a22-354e-43cd-a4e5-eef13cb66d1d', 'volume_name': 'volume-75d18a22-354e-43cd-a4e5-eef13cb66d1d', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16cfddfc-a556-4288-bd90-75e60c2cfdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16cfddfc-a556-4288-bd90-75e60c2cfdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e076e8-9674-4bc8-8100-64379f48fe9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:31 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Volume 75d18a22-354e-43cd-a4e5-eef13cb66d1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d18a22-354e-43cd-a4e5-eef13cb66d1d', 'volume_size': 1} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-782767108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d18a22-354e-43cd-a4e5-eef13cb66d1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6046403e605c41469ec9ba4c418a14af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:31Z,use_quota=True,user_id='054f1b8d538a4aa6977ad37856a34c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Creating volume 75d18a22-354e-43cd-a4e5-eef13cb66d1d {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:49:31 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75d18a22-354e-43cd-a4e5-eef13cb66d1d 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:31 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75d18a22-354e-43cd-a4e5-eef13cb66d1d 1073741824 Sep 07 13:49:31 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:31 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fbf33761-a54a-46cc-8ed6-8141745f3a9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.55e7f827-025b-4032-8db3-85ed8eaa079b" returned: 0 in 0.542s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-fbf33761-a54a-46cc-8ed6-8141745f3a9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1bf67b-9e39-4c1f-af91-ce8789a3f7dd]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fbf33761-a54a-46cc-8ed6-8141745f3a9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:31 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c Sep 07 13:49:31 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:32 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75d18a22-354e-43cd-a4e5-eef13cb66d1d 1073741824" returned: 0 in 0.438s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75d18a22-354e-43cd-a4e5-eef13cb66d1d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:32 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75d18a22-354e-43cd-a4e5-eef13cb66d1d Sep 07 13:49:32 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:32 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fbf33761-a54a-46cc-8ed6-8141745f3a9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c" returned: 0 in 0.435s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fbf33761-a54a-46cc-8ed6-8141745f3a9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.55e7f827-025b-4032-8db3-85ed8eaa079b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:32 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.55e7f827-025b-4032-8db3-85ed8eaa079b Sep 07 13:49:32 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:32 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75d18a22-354e-43cd-a4e5-eef13cb66d1d" returned: 0 in 0.271s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:49:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e076e8-9674-4bc8-8100-64379f48fe9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d18a22-354e-43cd-a4e5-eef13cb66d1d', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1f1855-f719-4d6a-85b0-5e6d480d0b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:32 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Volume volume-75d18a22-354e-43cd-a4e5-eef13cb66d1d (75d18a22-354e-43cd-a4e5-eef13cb66d1d): created successfully Sep 07 13:49:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1f1855-f719-4d6a-85b0-5e6d480d0b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Flow 'volume_create_manager' (ab6a8f41-2082-435b-999c-ded9eabd7b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:32 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-4a1258b8-128e-47a5-a428-04e9ac628d9e tempest-VolumesServicesTestJSON-293728287 None] Created volume successfully. Sep 07 13:49:32 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fbf33761-a54a-46cc-8ed6-8141745f3a9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.55e7f827-025b-4032-8db3-85ed8eaa079b" returned: 0 in 0.460s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fbf33761-a54a-46cc-8ed6-8141745f3a9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.55e7f827-025b-4032-8db3-85ed8eaa079b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:32 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.55e7f827-025b-4032-8db3-85ed8eaa079b Sep 07 13:49:32 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d371d108-261b-4c9b-9011-adc977fab9bd tempest-VolumesActionsTest-2090425500 None] Acquiring lock "cinder-80aedd00-c11a-4b7f-a92f-51bbeccd0e40-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d371d108-261b-4c9b-9011-adc977fab9bd tempest-VolumesActionsTest-2090425500 None] Lock "cinder-80aedd00-c11a-4b7f-a92f-51bbeccd0e40-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d371d108-261b-4c9b-9011-adc977fab9bd tempest-VolumesActionsTest-2090425500 None] Acquiring lock "cinder-quobyte-80aedd00-c11a-4b7f-a92f-51bbeccd0e40" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d371d108-261b-4c9b-9011-adc977fab9bd tempest-VolumesActionsTest-2090425500 None] Lock "cinder-quobyte-80aedd00-c11a-4b7f-a92f-51bbeccd0e40" acquired by "delete_volume" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:32 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc494cc5-e244-4786-a403-1d0bc9065593]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d371d108-261b-4c9b-9011-adc977fab9bd tempest-VolumesActionsTest-2090425500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-80aedd00-c11a-4b7f-a92f-51bbeccd0e40 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:32 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-80aedd00-c11a-4b7f-a92f-51bbeccd0e40 Sep 07 13:49:32 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:32 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fbf33761-a54a-46cc-8ed6-8141745f3a9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c.55e7f827-025b-4032-8db3-85ed8eaa079b" returned: 0 in 0.317s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fbf33761-a54a-46cc-8ed6-8141745f3a9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Lock "cinder-quobyte-55e7f827-025b-4032-8db3-85ed8eaa079b" released by "_delete_snapshot" :: held 1.892s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fbf33761-a54a-46cc-8ed6-8141745f3a9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Lock "cinder-quobyte-ec8a4854-aef3-49f6-802f-fd7a5d887b4c" released by "delete_snapshot" :: held 1.931s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:33 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-fbf33761-a54a-46cc-8ed6-8141745f3a9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Created reservations ['69444818-38f1-4314-8796-cac0d1e2a05d', '3a71b2d0-d0fc-4e6d-913a-7065921c2fdc', '5d05b742-af98-412d-a3f3-efab5181f4d4', '9ba3f4b7-c6f0-432a-97c9-ea7380f0dca3'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:33 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-fbf33761-a54a-46cc-8ed6-8141745f3a9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Delete snapshot completed successfully. Sep 07 13:49:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fbf33761-a54a-46cc-8ed6-8141745f3a9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Lock "cinder-55e7f827-025b-4032-8db3-85ed8eaa079b-delete_snapshot" released by "delete_snapshot" :: held 2.117s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:33 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d371d108-261b-4c9b-9011-adc977fab9bd tempest-VolumesActionsTest-2090425500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-80aedd00-c11a-4b7f-a92f-51bbeccd0e40" returned: 0 in 0.400s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d371d108-261b-4c9b-9011-adc977fab9bd tempest-VolumesActionsTest-2090425500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-80aedd00-c11a-4b7f-a92f-51bbeccd0e40 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:33 devstack sudo[95688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-80aedd00-c11a-4b7f-a92f-51bbeccd0e40 Sep 07 13:49:33 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-faae9972-d7b4-418f-9c26-617f5af5b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Acquiring lock "cinder-ec8a4854-aef3-49f6-802f-fd7a5d887b4c-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-faae9972-d7b4-418f-9c26-617f5af5b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Lock "cinder-ec8a4854-aef3-49f6-802f-fd7a5d887b4c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-faae9972-d7b4-418f-9c26-617f5af5b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Acquiring lock "cinder-quobyte-ec8a4854-aef3-49f6-802f-fd7a5d887b4c" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-faae9972-d7b4-418f-9c26-617f5af5b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Lock "cinder-quobyte-ec8a4854-aef3-49f6-802f-fd7a5d887b4c" acquired by "delete_volume" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:33 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[705ba2ae-099d-4180-9fac-f823d0c8a0f9]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-faae9972-d7b4-418f-9c26-617f5af5b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:33 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c Sep 07 13:49:33 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:33 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d371d108-261b-4c9b-9011-adc977fab9bd tempest-VolumesActionsTest-2090425500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-80aedd00-c11a-4b7f-a92f-51bbeccd0e40" returned: 0 in 0.334s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d371d108-261b-4c9b-9011-adc977fab9bd tempest-VolumesActionsTest-2090425500 None] Lock "cinder-quobyte-80aedd00-c11a-4b7f-a92f-51bbeccd0e40" released by "delete_volume" :: held 0.785s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:33 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-d371d108-261b-4c9b-9011-adc977fab9bd tempest-VolumesActionsTest-2090425500 None] Created reservations ['44bc00fb-56d7-4a86-9e9f-8e686cfaa2d2', 'fcc2c01e-96b3-4c43-af4d-ae9744978274', '50e8ed3c-c186-43b1-8a8a-608590aae117', '105533d6-13c1-4d17-b5a0-b268c1238a94'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d371d108-261b-4c9b-9011-adc977fab9bd tempest-VolumesActionsTest-2090425500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d371d108-261b-4c9b-9011-adc977fab9bd tempest-VolumesActionsTest-2090425500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d371d108-261b-4c9b-9011-adc977fab9bd tempest-VolumesActionsTest-2090425500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d371d108-261b-4c9b-9011-adc977fab9bd tempest-VolumesActionsTest-2090425500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d371d108-261b-4c9b-9011-adc977fab9bd tempest-VolumesActionsTest-2090425500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d371d108-261b-4c9b-9011-adc977fab9bd tempest-VolumesActionsTest-2090425500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:33 devstack sudo[95693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:49:33 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8e75a578-28c8-4b6c-8409-7040f1e385d6 tempest-VolumesServicesTestJSON-293728287 None] Acquiring lock "cinder-75d18a22-354e-43cd-a4e5-eef13cb66d1d-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:33 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-faae9972-d7b4-418f-9c26-617f5af5b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c" returned: 0 in 0.563s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-faae9972-d7b4-418f-9c26-617f5af5b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:34 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c Sep 07 13:49:34 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8e75a578-28c8-4b6c-8409-7040f1e385d6 tempest-VolumesServicesTestJSON-293728287 None] Lock "cinder-75d18a22-354e-43cd-a4e5-eef13cb66d1d-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8e75a578-28c8-4b6c-8409-7040f1e385d6 tempest-VolumesServicesTestJSON-293728287 None] Acquiring lock "cinder-quobyte-75d18a22-354e-43cd-a4e5-eef13cb66d1d" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8e75a578-28c8-4b6c-8409-7040f1e385d6 tempest-VolumesServicesTestJSON-293728287 None] Lock "cinder-quobyte-75d18a22-354e-43cd-a4e5-eef13cb66d1d" acquired by "delete_volume" :: waited 0.024s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d382cc-f4f5-421d-859f-c04a2d086f3f]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8e75a578-28c8-4b6c-8409-7040f1e385d6 tempest-VolumesServicesTestJSON-293728287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75d18a22-354e-43cd-a4e5-eef13cb66d1d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:34 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75d18a22-354e-43cd-a4e5-eef13cb66d1d Sep 07 13:49:34 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:34 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d371d108-261b-4c9b-9011-adc977fab9bd tempest-VolumesActionsTest-2090425500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.560s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-d371d108-261b-4c9b-9011-adc977fab9bd tempest-VolumesActionsTest-2090425500 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:49:34 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-d371d108-261b-4c9b-9011-adc977fab9bd tempest-VolumesActionsTest-2090425500 None] Deleted volume successfully. Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d371d108-261b-4c9b-9011-adc977fab9bd tempest-VolumesActionsTest-2090425500 None] Lock "cinder-80aedd00-c11a-4b7f-a92f-51bbeccd0e40-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:34 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-faae9972-d7b4-418f-9c26-617f5af5b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ec8a4854-aef3-49f6-802f-fd7a5d887b4c" returned: 0 in 0.505s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-faae9972-d7b4-418f-9c26-617f5af5b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Lock "cinder-quobyte-ec8a4854-aef3-49f6-802f-fd7a5d887b4c" released by "delete_volume" :: held 1.190s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-faae9972-d7b4-418f-9c26-617f5af5b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Created reservations ['cf743505-f227-4fe4-99ca-205c467e5576', '2146bc40-745b-4ba8-92f9-724e28ed0e26', '26d95e52-a2ca-433e-93fe-966a25ddf317', 'b246456f-958d-4bec-9680-a0826f072e5d'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-faae9972-d7b4-418f-9c26-617f5af5b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-faae9972-d7b4-418f-9c26-617f5af5b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-faae9972-d7b4-418f-9c26-617f5af5b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:34 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-faae9972-d7b4-418f-9c26-617f5af5b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-faae9972-d7b4-418f-9c26-617f5af5b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-faae9972-d7b4-418f-9c26-617f5af5b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8e75a578-28c8-4b6c-8409-7040f1e385d6 tempest-VolumesServicesTestJSON-293728287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75d18a22-354e-43cd-a4e5-eef13cb66d1d" returned: 0 in 0.639s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8e75a578-28c8-4b6c-8409-7040f1e385d6 tempest-VolumesServicesTestJSON-293728287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75d18a22-354e-43cd-a4e5-eef13cb66d1d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:34 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:49:34 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:34 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75d18a22-354e-43cd-a4e5-eef13cb66d1d Sep 07 13:49:34 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Flow 'volume_create_manager' (9fee40b7-b19f-4f7c-8bd4-a5271d35545d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64bec1cc-07ca-4c8c-a19b-6d7523bedd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64bec1cc-07ca-4c8c-a19b-6d7523bedd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2058841450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596cfd63-4b94-4769-bfcc-6d8ac5c3d961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820bd2c21e184e34b03df3bdca253419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:35Z,use_quota=True,user_id='41a9580f52b14925b32928cfe2a02728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e6da50-82c0-41da-8493-4228fa4c5c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e6da50-82c0-41da-8493-4228fa4c5c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5014802d-7bd0-431a-8e40-21c08f0ab488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5014802d-7bd0-431a-8e40-21c08f0ab488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '596cfd63-4b94-4769-bfcc-6d8ac5c3d961', 'volume_name': 'volume-596cfd63-4b94-4769-bfcc-6d8ac5c3d961', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec92cec-b351-46bc-9bf3-058f93485526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec92cec-b351-46bc-9bf3-058f93485526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd930c86-1643-46fa-814d-d53e9785dcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:34 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Volume 596cfd63-4b94-4769-bfcc-6d8ac5c3d961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-596cfd63-4b94-4769-bfcc-6d8ac5c3d961', 'volume_size': 1} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2058841450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596cfd63-4b94-4769-bfcc-6d8ac5c3d961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820bd2c21e184e34b03df3bdca253419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:35Z,use_quota=True,user_id='41a9580f52b14925b32928cfe2a02728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Creating volume 596cfd63-4b94-4769-bfcc-6d8ac5c3d961 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:49:34 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:49:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-596cfd63-4b94-4769-bfcc-6d8ac5c3d961 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:34 devstack sudo[95712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-596cfd63-4b94-4769-bfcc-6d8ac5c3d961 1073741824 Sep 07 13:49:34 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:35 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8e75a578-28c8-4b6c-8409-7040f1e385d6 tempest-VolumesServicesTestJSON-293728287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75d18a22-354e-43cd-a4e5-eef13cb66d1d" returned: 0 in 0.333s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:35 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-faae9972-d7b4-418f-9c26-617f5af5b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.362s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-faae9972-d7b4-418f-9c26-617f5af5b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8e75a578-28c8-4b6c-8409-7040f1e385d6 tempest-VolumesServicesTestJSON-293728287 None] Lock "cinder-quobyte-75d18a22-354e-43cd-a4e5-eef13cb66d1d" released by "delete_volume" :: held 1.041s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:35 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-faae9972-d7b4-418f-9c26-617f5af5b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Deleted volume successfully. Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-faae9972-d7b4-418f-9c26-617f5af5b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-1718878643 None] Lock "cinder-ec8a4854-aef3-49f6-802f-fd7a5d887b4c-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-8e75a578-28c8-4b6c-8409-7040f1e385d6 tempest-VolumesServicesTestJSON-293728287 None] Created reservations ['e8d5e63c-bcdd-4ae5-9611-16fe75ffff6d', '7727b3fe-b335-4ca4-b55b-cf5f27bc4d67', '75826196-7b38-4b6a-90b5-49b32d7f906f', '2c33cd09-4aae-435b-a2d9-a16051b0f283'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8e75a578-28c8-4b6c-8409-7040f1e385d6 tempest-VolumesServicesTestJSON-293728287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8e75a578-28c8-4b6c-8409-7040f1e385d6 tempest-VolumesServicesTestJSON-293728287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8e75a578-28c8-4b6c-8409-7040f1e385d6 tempest-VolumesServicesTestJSON-293728287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8e75a578-28c8-4b6c-8409-7040f1e385d6 tempest-VolumesServicesTestJSON-293728287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8e75a578-28c8-4b6c-8409-7040f1e385d6 tempest-VolumesServicesTestJSON-293728287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8e75a578-28c8-4b6c-8409-7040f1e385d6 tempest-VolumesServicesTestJSON-293728287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:35 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:49:35 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:35 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-596cfd63-4b94-4769-bfcc-6d8ac5c3d961 1073741824" returned: 0 in 0.512s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-596cfd63-4b94-4769-bfcc-6d8ac5c3d961 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:35 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-596cfd63-4b94-4769-bfcc-6d8ac5c3d961 Sep 07 13:49:35 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:35 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8e75a578-28c8-4b6c-8409-7040f1e385d6 tempest-VolumesServicesTestJSON-293728287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.279s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-8e75a578-28c8-4b6c-8409-7040f1e385d6 tempest-VolumesServicesTestJSON-293728287 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:49:35 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-8e75a578-28c8-4b6c-8409-7040f1e385d6 tempest-VolumesServicesTestJSON-293728287 None] Deleted volume successfully. Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8e75a578-28c8-4b6c-8409-7040f1e385d6 tempest-VolumesServicesTestJSON-293728287 None] Lock "cinder-75d18a22-354e-43cd-a4e5-eef13cb66d1d-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:35 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-596cfd63-4b94-4769-bfcc-6d8ac5c3d961" returned: 0 in 0.386s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd930c86-1643-46fa-814d-d53e9785dcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-596cfd63-4b94-4769-bfcc-6d8ac5c3d961', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20eaad2-8661-420f-aee3-f1686a56619a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:35 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Volume volume-596cfd63-4b94-4769-bfcc-6d8ac5c3d961 (596cfd63-4b94-4769-bfcc-6d8ac5c3d961): created successfully Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20eaad2-8661-420f-aee3-f1686a56619a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:35 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Flow 'volume_create_manager' (9fee40b7-b19f-4f7c-8bd4-a5271d35545d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:35 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-9032c78b-e419-4108-ab23-3519a1377fc8 tempest-VolumesActionsTest-1399979072 None] Created volume successfully. Sep 07 13:49:37 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-74391b12-f835-47b5-a17d-820666877a38 tempest-VolumesActionsTest-2090425500 None] Acquiring lock "cinder-596cfd63-4b94-4769-bfcc-6d8ac5c3d961-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:37 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-74391b12-f835-47b5-a17d-820666877a38 tempest-VolumesActionsTest-2090425500 None] Lock "cinder-596cfd63-4b94-4769-bfcc-6d8ac5c3d961-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:37 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-74391b12-f835-47b5-a17d-820666877a38 tempest-VolumesActionsTest-2090425500 None] Acquiring lock "cinder-quobyte-596cfd63-4b94-4769-bfcc-6d8ac5c3d961" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:37 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-74391b12-f835-47b5-a17d-820666877a38 tempest-VolumesActionsTest-2090425500 None] Lock "cinder-quobyte-596cfd63-4b94-4769-bfcc-6d8ac5c3d961" acquired by "delete_volume" :: waited 0.031s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:37 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a24745-c42a-43b7-9681-df0d5275cb1b]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-74391b12-f835-47b5-a17d-820666877a38 tempest-VolumesActionsTest-2090425500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-596cfd63-4b94-4769-bfcc-6d8ac5c3d961 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:37 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-596cfd63-4b94-4769-bfcc-6d8ac5c3d961 Sep 07 13:49:37 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:37 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-74391b12-f835-47b5-a17d-820666877a38 tempest-VolumesActionsTest-2090425500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-596cfd63-4b94-4769-bfcc-6d8ac5c3d961" returned: 0 in 0.522s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-74391b12-f835-47b5-a17d-820666877a38 tempest-VolumesActionsTest-2090425500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-596cfd63-4b94-4769-bfcc-6d8ac5c3d961 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:37 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-596cfd63-4b94-4769-bfcc-6d8ac5c3d961 Sep 07 13:49:37 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:38 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-74391b12-f835-47b5-a17d-820666877a38 tempest-VolumesActionsTest-2090425500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-596cfd63-4b94-4769-bfcc-6d8ac5c3d961" returned: 0 in 0.330s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-74391b12-f835-47b5-a17d-820666877a38 tempest-VolumesActionsTest-2090425500 None] Lock "cinder-quobyte-596cfd63-4b94-4769-bfcc-6d8ac5c3d961" released by "delete_volume" :: held 0.918s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:38 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-74391b12-f835-47b5-a17d-820666877a38 tempest-VolumesActionsTest-2090425500 None] Created reservations ['98ecb314-d686-4246-bd2c-30957f2cebc4', 'dbfd3fa9-3fd0-4d91-bb14-fa996d8ef365', 'cb0a2148-19f8-4505-b65e-3356f5f94e81', '2a63ce47-5b83-4345-82b6-d9945d7dcef0'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-74391b12-f835-47b5-a17d-820666877a38 tempest-VolumesActionsTest-2090425500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-74391b12-f835-47b5-a17d-820666877a38 tempest-VolumesActionsTest-2090425500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-74391b12-f835-47b5-a17d-820666877a38 tempest-VolumesActionsTest-2090425500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-74391b12-f835-47b5-a17d-820666877a38 tempest-VolumesActionsTest-2090425500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-74391b12-f835-47b5-a17d-820666877a38 tempest-VolumesActionsTest-2090425500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-74391b12-f835-47b5-a17d-820666877a38 tempest-VolumesActionsTest-2090425500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:38 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:49:38 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:38 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-74391b12-f835-47b5-a17d-820666877a38 tempest-VolumesActionsTest-2090425500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.419s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:38 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-74391b12-f835-47b5-a17d-820666877a38 tempest-VolumesActionsTest-2090425500 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:49:38 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-74391b12-f835-47b5-a17d-820666877a38 tempest-VolumesActionsTest-2090425500 None] Deleted volume successfully. Sep 07 13:49:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-74391b12-f835-47b5-a17d-820666877a38 tempest-VolumesActionsTest-2090425500 None] Lock "cinder-596cfd63-4b94-4769-bfcc-6d8ac5c3d961-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Flow 'volume_create_manager' (32ef2ab9-55e0-4884-97af-fb93504a7e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925a27d0-948a-4177-93a7-18a7d79c3033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925a27d0-948a-4177-93a7-18a7d79c3033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-755732170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07da33ae-5722-443b-9446-2ec65cee3e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820bd2c21e184e34b03df3bdca253419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:40Z,use_quota=True,user_id='41a9580f52b14925b32928cfe2a02728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b9f06b-1431-4d85-92e6-21d247483cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b9f06b-1431-4d85-92e6-21d247483cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e59081-dfec-4f80-b3ec-0540e6dfd958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e59081-dfec-4f80-b3ec-0540e6dfd958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07da33ae-5722-443b-9446-2ec65cee3e62', 'volume_name': 'volume-07da33ae-5722-443b-9446-2ec65cee3e62', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71aa505f-b679-4e15-9cd4-dfc0c8a9b73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71aa505f-b679-4e15-9cd4-dfc0c8a9b73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4164d1-a8a5-4f00-83ab-9691439adb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:40 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Volume 07da33ae-5722-443b-9446-2ec65cee3e62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07da33ae-5722-443b-9446-2ec65cee3e62', 'volume_size': 1} Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-755732170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07da33ae-5722-443b-9446-2ec65cee3e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820bd2c21e184e34b03df3bdca253419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:40Z,use_quota=True,user_id='41a9580f52b14925b32928cfe2a02728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Creating volume 07da33ae-5722-443b-9446-2ec65cee3e62 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:49:40 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-07da33ae-5722-443b-9446-2ec65cee3e62 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:40 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-07da33ae-5722-443b-9446-2ec65cee3e62 1073741824 Sep 07 13:49:40 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:40 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-07da33ae-5722-443b-9446-2ec65cee3e62 1073741824" returned: 0 in 0.528s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-07da33ae-5722-443b-9446-2ec65cee3e62 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:40 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-07da33ae-5722-443b-9446-2ec65cee3e62 Sep 07 13:49:40 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:41 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-07da33ae-5722-443b-9446-2ec65cee3e62" returned: 0 in 0.312s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:41 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:49:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4164d1-a8a5-4f00-83ab-9691439adb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07da33ae-5722-443b-9446-2ec65cee3e62', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9ed874-29e6-4807-a4fc-57a4d1c27aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:41 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Volume volume-07da33ae-5722-443b-9446-2ec65cee3e62 (07da33ae-5722-443b-9446-2ec65cee3e62): created successfully Sep 07 13:49:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9ed874-29e6-4807-a4fc-57a4d1c27aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Flow 'volume_create_manager' (32ef2ab9-55e0-4884-97af-fb93504a7e6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:41 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-436f82bc-8fd7-44c8-ab2e-0e05807068aa tempest-VolumesActionsTest-1399979072 None] Created volume successfully. Sep 07 13:49:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-51147b64-6875-42f0-9f48-4024261a8034 tempest-VolumesActionsTest-2090425500 None] Acquiring lock "cinder-07da33ae-5722-443b-9446-2ec65cee3e62-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-51147b64-6875-42f0-9f48-4024261a8034 tempest-VolumesActionsTest-2090425500 None] Lock "cinder-07da33ae-5722-443b-9446-2ec65cee3e62-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-51147b64-6875-42f0-9f48-4024261a8034 tempest-VolumesActionsTest-2090425500 None] Acquiring lock "cinder-quobyte-07da33ae-5722-443b-9446-2ec65cee3e62" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-51147b64-6875-42f0-9f48-4024261a8034 tempest-VolumesActionsTest-2090425500 None] Lock "cinder-quobyte-07da33ae-5722-443b-9446-2ec65cee3e62" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:42 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c487282-76d7-4cc9-8f2d-1ed8eaccaedb]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-51147b64-6875-42f0-9f48-4024261a8034 tempest-VolumesActionsTest-2090425500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-07da33ae-5722-443b-9446-2ec65cee3e62 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:42 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-07da33ae-5722-443b-9446-2ec65cee3e62 Sep 07 13:49:42 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:42 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-51147b64-6875-42f0-9f48-4024261a8034 tempest-VolumesActionsTest-2090425500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-07da33ae-5722-443b-9446-2ec65cee3e62" returned: 0 in 0.421s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-51147b64-6875-42f0-9f48-4024261a8034 tempest-VolumesActionsTest-2090425500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-07da33ae-5722-443b-9446-2ec65cee3e62 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:42 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-07da33ae-5722-443b-9446-2ec65cee3e62 Sep 07 13:49:42 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:43 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-51147b64-6875-42f0-9f48-4024261a8034 tempest-VolumesActionsTest-2090425500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-07da33ae-5722-443b-9446-2ec65cee3e62" returned: 0 in 0.282s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-51147b64-6875-42f0-9f48-4024261a8034 tempest-VolumesActionsTest-2090425500 None] Lock "cinder-quobyte-07da33ae-5722-443b-9446-2ec65cee3e62" released by "delete_volume" :: held 0.753s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:43 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-51147b64-6875-42f0-9f48-4024261a8034 tempest-VolumesActionsTest-2090425500 None] Created reservations ['f08f068f-8c69-40fd-b86b-d93c0a136afe', 'e6367703-e26b-476f-b675-a9d2545311d8', 'a6dee773-d9d0-4a43-8036-40b9c08c0f12', '930f9c38-409b-43c6-a9e6-891977e58688'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-51147b64-6875-42f0-9f48-4024261a8034 tempest-VolumesActionsTest-2090425500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-51147b64-6875-42f0-9f48-4024261a8034 tempest-VolumesActionsTest-2090425500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-51147b64-6875-42f0-9f48-4024261a8034 tempest-VolumesActionsTest-2090425500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-51147b64-6875-42f0-9f48-4024261a8034 tempest-VolumesActionsTest-2090425500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-51147b64-6875-42f0-9f48-4024261a8034 tempest-VolumesActionsTest-2090425500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-51147b64-6875-42f0-9f48-4024261a8034 tempest-VolumesActionsTest-2090425500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:43 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:49:43 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:43 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-51147b64-6875-42f0-9f48-4024261a8034 tempest-VolumesActionsTest-2090425500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.348s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:43 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-51147b64-6875-42f0-9f48-4024261a8034 tempest-VolumesActionsTest-2090425500 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:49:43 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-51147b64-6875-42f0-9f48-4024261a8034 tempest-VolumesActionsTest-2090425500 None] Deleted volume successfully. Sep 07 13:49:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-51147b64-6875-42f0-9f48-4024261a8034 tempest-VolumesActionsTest-2090425500 None] Lock "cinder-07da33ae-5722-443b-9446-2ec65cee3e62-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:44 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:49:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Flow 'volume_create_manager' (853d1e49-0a46-4a80-b9a0-dcea05b6a0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50735df-7887-4a15-8fce-e74b23cfcf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50735df-7887-4a15-8fce-e74b23cfcf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1115463282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a3ec96-b268-486c-90af-d88bf914216c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820bd2c21e184e34b03df3bdca253419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:44Z,use_quota=True,user_id='41a9580f52b14925b32928cfe2a02728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de8f68b-552d-4a90-86c2-d3b71f6ede9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de8f68b-552d-4a90-86c2-d3b71f6ede9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7162ea51-cb2f-4f29-8a27-39fcb685661a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7162ea51-cb2f-4f29-8a27-39fcb685661a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9a3ec96-b268-486c-90af-d88bf914216c', 'volume_name': 'volume-c9a3ec96-b268-486c-90af-d88bf914216c', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64800ee6-ae36-4fdf-adcd-052abf5dc306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64800ee6-ae36-4fdf-adcd-052abf5dc306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (535de66c-624d-4fe3-9639-7c4b257852e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:44 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Volume c9a3ec96-b268-486c-90af-d88bf914216c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9a3ec96-b268-486c-90af-d88bf914216c', 'volume_size': 1} Sep 07 13:49:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1115463282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a3ec96-b268-486c-90af-d88bf914216c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820bd2c21e184e34b03df3bdca253419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:44Z,use_quota=True,user_id='41a9580f52b14925b32928cfe2a02728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:49:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Creating volume c9a3ec96-b268-486c-90af-d88bf914216c {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:49:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:49:44 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:49:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c9a3ec96-b268-486c-90af-d88bf914216c 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:44 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c9a3ec96-b268-486c-90af-d88bf914216c 1073741824 Sep 07 13:49:44 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:44 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c9a3ec96-b268-486c-90af-d88bf914216c 1073741824" returned: 0 in 0.634s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c9a3ec96-b268-486c-90af-d88bf914216c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:45 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c9a3ec96-b268-486c-90af-d88bf914216c Sep 07 13:49:45 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:45 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c9a3ec96-b268-486c-90af-d88bf914216c" returned: 0 in 0.372s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:45 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:49:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:45 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (535de66c-624d-4fe3-9639-7c4b257852e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9a3ec96-b268-486c-90af-d88bf914216c', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:45 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66f5be0-b18e-4f3f-8618-38cacb22867a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:45 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Volume volume-c9a3ec96-b268-486c-90af-d88bf914216c (c9a3ec96-b268-486c-90af-d88bf914216c): created successfully Sep 07 13:49:45 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66f5be0-b18e-4f3f-8618-38cacb22867a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:45 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Flow 'volume_create_manager' (853d1e49-0a46-4a80-b9a0-dcea05b6a0f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:45 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-7eb47ea9-49b6-48e2-8e67-bafafa9eabf9 tempest-VolumesActionsTest-1399979072 None] Created volume successfully. Sep 07 13:49:46 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-43f4aae3-08a2-4710-9fae-73df5ee80b0e tempest-VolumesActionsTest-2090425500 None] Acquiring lock "cinder-c9a3ec96-b268-486c-90af-d88bf914216c-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:46 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-43f4aae3-08a2-4710-9fae-73df5ee80b0e tempest-VolumesActionsTest-2090425500 None] Lock "cinder-c9a3ec96-b268-486c-90af-d88bf914216c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:46 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-43f4aae3-08a2-4710-9fae-73df5ee80b0e tempest-VolumesActionsTest-2090425500 None] Acquiring lock "cinder-quobyte-c9a3ec96-b268-486c-90af-d88bf914216c" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:46 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-43f4aae3-08a2-4710-9fae-73df5ee80b0e tempest-VolumesActionsTest-2090425500 None] Lock "cinder-quobyte-c9a3ec96-b268-486c-90af-d88bf914216c" acquired by "delete_volume" :: waited 0.025s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:46 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef54a31-51df-47d1-b13a-98c1eecd8652]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-43f4aae3-08a2-4710-9fae-73df5ee80b0e tempest-VolumesActionsTest-2090425500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c9a3ec96-b268-486c-90af-d88bf914216c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:46 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c9a3ec96-b268-486c-90af-d88bf914216c Sep 07 13:49:46 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:47 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-43f4aae3-08a2-4710-9fae-73df5ee80b0e tempest-VolumesActionsTest-2090425500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c9a3ec96-b268-486c-90af-d88bf914216c" returned: 0 in 0.560s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-43f4aae3-08a2-4710-9fae-73df5ee80b0e tempest-VolumesActionsTest-2090425500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c9a3ec96-b268-486c-90af-d88bf914216c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:47 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c9a3ec96-b268-486c-90af-d88bf914216c Sep 07 13:49:47 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:47 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-43f4aae3-08a2-4710-9fae-73df5ee80b0e tempest-VolumesActionsTest-2090425500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c9a3ec96-b268-486c-90af-d88bf914216c" returned: 0 in 0.325s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-43f4aae3-08a2-4710-9fae-73df5ee80b0e tempest-VolumesActionsTest-2090425500 None] Lock "cinder-quobyte-c9a3ec96-b268-486c-90af-d88bf914216c" released by "delete_volume" :: held 0.966s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:47 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-43f4aae3-08a2-4710-9fae-73df5ee80b0e tempest-VolumesActionsTest-2090425500 None] Created reservations ['21849986-c908-418b-854c-420edc5ef307', '58240911-f964-4401-a908-5c6e7625ae0b', '15e6ffdd-9ec5-4213-88bf-d07450c4f914', '9f6c3322-e970-4c5a-9a17-ee9ea466478b'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-43f4aae3-08a2-4710-9fae-73df5ee80b0e tempest-VolumesActionsTest-2090425500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-43f4aae3-08a2-4710-9fae-73df5ee80b0e tempest-VolumesActionsTest-2090425500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-43f4aae3-08a2-4710-9fae-73df5ee80b0e tempest-VolumesActionsTest-2090425500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-43f4aae3-08a2-4710-9fae-73df5ee80b0e tempest-VolumesActionsTest-2090425500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-43f4aae3-08a2-4710-9fae-73df5ee80b0e tempest-VolumesActionsTest-2090425500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-43f4aae3-08a2-4710-9fae-73df5ee80b0e tempest-VolumesActionsTest-2090425500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:47 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:49:47 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:48 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-43f4aae3-08a2-4710-9fae-73df5ee80b0e tempest-VolumesActionsTest-2090425500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.290s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:48 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-43f4aae3-08a2-4710-9fae-73df5ee80b0e tempest-VolumesActionsTest-2090425500 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:49:48 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-43f4aae3-08a2-4710-9fae-73df5ee80b0e tempest-VolumesActionsTest-2090425500 None] Deleted volume successfully. Sep 07 13:49:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-43f4aae3-08a2-4710-9fae-73df5ee80b0e tempest-VolumesActionsTest-2090425500 None] Lock "cinder-c9a3ec96-b268-486c-90af-d88bf914216c-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:49 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:49:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Flow 'volume_create_manager' (d4465b8e-3123-4fd8-9c46-a1f7c0c7847b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7729555a-392f-4ab7-bf00-8c6bf410fb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7729555a-392f-4ab7-bf00-8c6bf410fb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-731822999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6f10cf-187e-4a09-ac8e-62b36f028b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820bd2c21e184e34b03df3bdca253419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:50Z,use_quota=True,user_id='41a9580f52b14925b32928cfe2a02728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc2c5ed-a209-4578-af90-54f61cc0eef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc2c5ed-a209-4578-af90-54f61cc0eef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eaf150b-77bb-4223-88ec-4ce370274b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eaf150b-77bb-4223-88ec-4ce370274b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df6f10cf-187e-4a09-ac8e-62b36f028b08', 'volume_name': 'volume-df6f10cf-187e-4a09-ac8e-62b36f028b08', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee6f69d-afeb-4728-a42f-4567137d20f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee6f69d-afeb-4728-a42f-4567137d20f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9201b440-3ffd-4e9e-9546-965cb754acd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:49 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Volume df6f10cf-187e-4a09-ac8e-62b36f028b08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df6f10cf-187e-4a09-ac8e-62b36f028b08', 'volume_size': 1} Sep 07 13:49:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:49 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-731822999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6f10cf-187e-4a09-ac8e-62b36f028b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820bd2c21e184e34b03df3bdca253419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:50Z,use_quota=True,user_id='41a9580f52b14925b32928cfe2a02728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:49:49 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Creating volume df6f10cf-187e-4a09-ac8e-62b36f028b08 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:49:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:49 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:49 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:49 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:49:49 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:49:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df6f10cf-187e-4a09-ac8e-62b36f028b08 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:49 devstack sudo[95879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df6f10cf-187e-4a09-ac8e-62b36f028b08 1073741824 Sep 07 13:49:49 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:50 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df6f10cf-187e-4a09-ac8e-62b36f028b08 1073741824" returned: 0 in 0.632s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df6f10cf-187e-4a09-ac8e-62b36f028b08 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:50 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df6f10cf-187e-4a09-ac8e-62b36f028b08 Sep 07 13:49:50 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:51 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df6f10cf-187e-4a09-ac8e-62b36f028b08" returned: 0 in 0.500s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9201b440-3ffd-4e9e-9546-965cb754acd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df6f10cf-187e-4a09-ac8e-62b36f028b08', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7518af14-aa16-41ba-8ca2-09f0c7760b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:51 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Volume volume-df6f10cf-187e-4a09-ac8e-62b36f028b08 (df6f10cf-187e-4a09-ac8e-62b36f028b08): created successfully Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7518af14-aa16-41ba-8ca2-09f0c7760b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Flow 'volume_create_manager' (d4465b8e-3123-4fd8-9c46-a1f7c0c7847b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:51 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-a2a671b7-682b-4d55-b30b-10dfc339cc78 tempest-VolumesActionsTest-1399979072 None] Created volume successfully. Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Flow 'volume_create_manager' (b5b224d9-fe39-4524-ac3d-86590b971e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9605736-5d9f-47ca-a704-9bb0af04de96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9605736-5d9f-47ca-a704-9bb0af04de96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1100247746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aef549c-5fd1-4e9a-95bf-b8419ee57867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e81b8dd6e1c427f902e5a2c4213101d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:51Z,use_quota=True,user_id='e0be20a57ecb46588904af7a98fce629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c126c2d4-ab3e-4283-8a4b-71c0cc9e7c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c126c2d4-ab3e-4283-8a4b-71c0cc9e7c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4cf4b9d-e250-4f9c-b66a-1e800118cd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4cf4b9d-e250-4f9c-b66a-1e800118cd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aef549c-5fd1-4e9a-95bf-b8419ee57867', 'volume_name': 'volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5632c95d-0cd0-47e1-ac7c-870c23d09bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5632c95d-0cd0-47e1-ac7c-870c23d09bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08cda29-2bd2-473a-a572-36d7e27a47ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:51 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Volume 6aef549c-5fd1-4e9a-95bf-b8419ee57867: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867', 'volume_size': 1} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1100247746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aef549c-5fd1-4e9a-95bf-b8419ee57867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e81b8dd6e1c427f902e5a2c4213101d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:51Z,use_quota=True,user_id='e0be20a57ecb46588904af7a98fce629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Creating volume 6aef549c-5fd1-4e9a-95bf-b8419ee57867 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:49:51 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:49:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:51 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 1073741824 Sep 07 13:49:51 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:52 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-97997249-50f6-4a69-9d42-c55287ff6919 req-9132bd59-2c30-4067-870d-7acc47380b08 tempest-ServerActionsTestOtherA-611322616 None] Terminate volume connection completed successfully. Sep 07 13:49:52 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-97997249-50f6-4a69-9d42-c55287ff6919 req-9132bd59-2c30-4067-870d-7acc47380b08 tempest-ServerActionsTestOtherA-611322616 None] Deleting attachment b6390b4e-87f0-497d-bce2-d9f45d4612f7. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:49:52 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 1073741824" returned: 0 in 0.763s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:52 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 Sep 07 13:49:52 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:52 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-97997249-50f6-4a69-9d42-c55287ff6919 req-68e81252-99e5-41d6-a200-e56f36349022 tempest-ServerActionsTestOtherA-611322616 None] Acquiring lock "cinder-49b253d3-6e87-4ec9-ba08-60da34ee6875-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:52 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-97997249-50f6-4a69-9d42-c55287ff6919 req-68e81252-99e5-41d6-a200-e56f36349022 tempest-ServerActionsTestOtherA-611322616 None] Lock "cinder-49b253d3-6e87-4ec9-ba08-60da34ee6875-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:52 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-97997249-50f6-4a69-9d42-c55287ff6919 req-68e81252-99e5-41d6-a200-e56f36349022 tempest-ServerActionsTestOtherA-611322616 None] Acquiring lock "cinder-quobyte-49b253d3-6e87-4ec9-ba08-60da34ee6875" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:52 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-97997249-50f6-4a69-9d42-c55287ff6919 req-68e81252-99e5-41d6-a200-e56f36349022 tempest-ServerActionsTestOtherA-611322616 None] Lock "cinder-quobyte-49b253d3-6e87-4ec9-ba08-60da34ee6875" acquired by "delete_volume" :: waited 0.031s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:52 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb083a3-f14e-4742-b4a9-5e07b6eca47f]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-97997249-50f6-4a69-9d42-c55287ff6919 req-68e81252-99e5-41d6-a200-e56f36349022 tempest-ServerActionsTestOtherA-611322616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49b253d3-6e87-4ec9-ba08-60da34ee6875 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:52 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867" returned: 0 in 0.365s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:52 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:49:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:52 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08cda29-2bd2-473a-a572-36d7e27a47ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:52 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a4dcdbc-beda-4b9d-85b5-743b6dfba6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:52 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-47a87311-0f35-4fbf-9c57-7518a387a503 tempest-VolumesActionsTest-1399979072 None] Acquiring lock "cinder-df6f10cf-187e-4a09-ac8e-62b36f028b08-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:52 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Volume volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 (6aef549c-5fd1-4e9a-95bf-b8419ee57867): created successfully Sep 07 13:49:52 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a4dcdbc-beda-4b9d-85b5-743b6dfba6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:52 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Flow 'volume_create_manager' (b5b224d9-fe39-4524-ac3d-86590b971e25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:52 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-47a87311-0f35-4fbf-9c57-7518a387a503 tempest-VolumesActionsTest-1399979072 None] Lock "cinder-df6f10cf-187e-4a09-ac8e-62b36f028b08-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:52 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-d428e131-d33c-4573-8c0a-26a3d67fe7c5 tempest-VolumesDeleteCascade-1249194852 None] Created volume successfully. Sep 07 13:49:52 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-47a87311-0f35-4fbf-9c57-7518a387a503 tempest-VolumesActionsTest-1399979072 None] Acquiring lock "cinder-quobyte-df6f10cf-187e-4a09-ac8e-62b36f028b08" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:52 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49b253d3-6e87-4ec9-ba08-60da34ee6875 Sep 07 13:49:52 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:52 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-47a87311-0f35-4fbf-9c57-7518a387a503 tempest-VolumesActionsTest-1399979072 None] Lock "cinder-quobyte-df6f10cf-187e-4a09-ac8e-62b36f028b08" acquired by "delete_volume" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:53 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc4cfb2-0d25-48bf-89b5-50a4fba8437b]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-47a87311-0f35-4fbf-9c57-7518a387a503 tempest-VolumesActionsTest-1399979072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df6f10cf-187e-4a09-ac8e-62b36f028b08 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:53 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df6f10cf-187e-4a09-ac8e-62b36f028b08 Sep 07 13:49:53 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:53 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-97997249-50f6-4a69-9d42-c55287ff6919 req-68e81252-99e5-41d6-a200-e56f36349022 tempest-ServerActionsTestOtherA-611322616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49b253d3-6e87-4ec9-ba08-60da34ee6875" returned: 0 in 0.667s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-97997249-50f6-4a69-9d42-c55287ff6919 req-68e81252-99e5-41d6-a200-e56f36349022 tempest-ServerActionsTestOtherA-611322616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49b253d3-6e87-4ec9-ba08-60da34ee6875 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:53 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49b253d3-6e87-4ec9-ba08-60da34ee6875 Sep 07 13:49:53 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:53 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-47a87311-0f35-4fbf-9c57-7518a387a503 tempest-VolumesActionsTest-1399979072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df6f10cf-187e-4a09-ac8e-62b36f028b08" returned: 0 in 0.488s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-47a87311-0f35-4fbf-9c57-7518a387a503 tempest-VolumesActionsTest-1399979072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df6f10cf-187e-4a09-ac8e-62b36f028b08 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:53 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df6f10cf-187e-4a09-ac8e-62b36f028b08 Sep 07 13:49:53 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:53 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-97997249-50f6-4a69-9d42-c55287ff6919 req-68e81252-99e5-41d6-a200-e56f36349022 tempest-ServerActionsTestOtherA-611322616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49b253d3-6e87-4ec9-ba08-60da34ee6875" returned: 0 in 0.346s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:53 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-97997249-50f6-4a69-9d42-c55287ff6919 req-68e81252-99e5-41d6-a200-e56f36349022 tempest-ServerActionsTestOtherA-611322616 None] Lock "cinder-quobyte-49b253d3-6e87-4ec9-ba08-60da34ee6875" released by "delete_volume" :: held 1.101s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:53 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-47a87311-0f35-4fbf-9c57-7518a387a503 tempest-VolumesActionsTest-1399979072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df6f10cf-187e-4a09-ac8e-62b36f028b08" returned: 0 in 0.350s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-07a3f06c-87f6-4c93-b78a-b44f66cad129 tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-07a3f06c-87f6-4c93-b78a-b44f66cad129 tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:53 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-47a87311-0f35-4fbf-9c57-7518a387a503 tempest-VolumesActionsTest-1399979072 None] Lock "cinder-quobyte-df6f10cf-187e-4a09-ac8e-62b36f028b08" released by "delete_volume" :: held 0.899s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:53 devstack cinder-volume[87571]: DEBUG cinder.quota [req-97997249-50f6-4a69-9d42-c55287ff6919 req-68e81252-99e5-41d6-a200-e56f36349022 tempest-ServerActionsTestOtherA-611322616 None] Created reservations ['0986ee43-a0ae-4d48-a7f6-b9ed966bc3e7', 'ab947bb7-6147-4820-a4b5-6f3e71ee95c0', 'e601afad-08d9-4d30-a212-6d2721bea710', 'e00b7d5a-0aee-4c14-bfa8-238a6368e705'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-07a3f06c-87f6-4c93-b78a-b44f66cad129 tempest-VolumesDeleteCascade-1249194852 None] Creating offline snapshot 1174ccb5-923c-4d84-b74b-a6d6ecc40313 of volume 6aef549c-5fd1-4e9a-95bf-b8419ee57867 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:49:53 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d76452-10c6-4ac7-b179-640d9c84863d]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-07a3f06c-87f6-4c93-b78a-b44f66cad129 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:53 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-47a87311-0f35-4fbf-9c57-7518a387a503 tempest-VolumesActionsTest-1399979072 None] Created reservations ['9be4aafb-b7f4-4511-b9d9-fd911f1eeb8b', '7df5c965-ebdd-436d-9739-27946751cc5e', 'e160e48d-d655-4e83-bd41-ce3c00007954', '7b423ec0-f3bf-46b2-93b5-328d2aab82b8'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-97997249-50f6-4a69-9d42-c55287ff6919 req-68e81252-99e5-41d6-a200-e56f36349022 tempest-ServerActionsTestOtherA-611322616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-97997249-50f6-4a69-9d42-c55287ff6919 req-68e81252-99e5-41d6-a200-e56f36349022 tempest-ServerActionsTestOtherA-611322616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [req-97997249-50f6-4a69-9d42-c55287ff6919 req-68e81252-99e5-41d6-a200-e56f36349022 tempest-ServerActionsTestOtherA-611322616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [req-97997249-50f6-4a69-9d42-c55287ff6919 req-68e81252-99e5-41d6-a200-e56f36349022 tempest-ServerActionsTestOtherA-611322616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-97997249-50f6-4a69-9d42-c55287ff6919 req-68e81252-99e5-41d6-a200-e56f36349022 tempest-ServerActionsTestOtherA-611322616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-97997249-50f6-4a69-9d42-c55287ff6919 req-68e81252-99e5-41d6-a200-e56f36349022 tempest-ServerActionsTestOtherA-611322616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:54 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 Sep 07 13:49:54 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:54 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:49:54 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-47a87311-0f35-4fbf-9c57-7518a387a503 tempest-VolumesActionsTest-1399979072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-47a87311-0f35-4fbf-9c57-7518a387a503 tempest-VolumesActionsTest-1399979072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-47a87311-0f35-4fbf-9c57-7518a387a503 tempest-VolumesActionsTest-1399979072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-47a87311-0f35-4fbf-9c57-7518a387a503 tempest-VolumesActionsTest-1399979072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-47a87311-0f35-4fbf-9c57-7518a387a503 tempest-VolumesActionsTest-1399979072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-47a87311-0f35-4fbf-9c57-7518a387a503 tempest-VolumesActionsTest-1399979072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:54 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:49:54 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:54 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-97997249-50f6-4a69-9d42-c55287ff6919 req-68e81252-99e5-41d6-a200-e56f36349022 tempest-ServerActionsTestOtherA-611322616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.326s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG cinder.manager [req-97997249-50f6-4a69-9d42-c55287ff6919 req-68e81252-99e5-41d6-a200-e56f36349022 tempest-ServerActionsTestOtherA-611322616 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:49:54 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-97997249-50f6-4a69-9d42-c55287ff6919 req-68e81252-99e5-41d6-a200-e56f36349022 tempest-ServerActionsTestOtherA-611322616 None] Deleted volume successfully. Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-97997249-50f6-4a69-9d42-c55287ff6919 req-68e81252-99e5-41d6-a200-e56f36349022 tempest-ServerActionsTestOtherA-611322616 None] Lock "cinder-49b253d3-6e87-4ec9-ba08-60da34ee6875-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:54 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-47a87311-0f35-4fbf-9c57-7518a387a503 tempest-VolumesActionsTest-1399979072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.304s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-47a87311-0f35-4fbf-9c57-7518a387a503 tempest-VolumesActionsTest-1399979072 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:49:54 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-47a87311-0f35-4fbf-9c57-7518a387a503 tempest-VolumesActionsTest-1399979072 None] Deleted volume successfully. Sep 07 13:49:54 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-07a3f06c-87f6-4c93-b78a-b44f66cad129 tempest-VolumesDeleteCascade-1249194852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867" returned: 0 in 0.512s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-07a3f06c-87f6-4c93-b78a-b44f66cad129 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:54 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313 1G Sep 07 13:49:54 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-47a87311-0f35-4fbf-9c57-7518a387a503 tempest-VolumesActionsTest-1399979072 None] Lock "cinder-df6f10cf-187e-4a09-ac8e-62b36f028b08-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06f373cc-1aa6-4e8f-b1ed-ecffa8b2e3a9 tempest-ServerActionsTestOtherA-611322616 None] Acquiring lock "cinder-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06f373cc-1aa6-4e8f-b1ed-ecffa8b2e3a9 tempest-ServerActionsTestOtherA-611322616 None] Lock "cinder-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06f373cc-1aa6-4e8f-b1ed-ecffa8b2e3a9 tempest-ServerActionsTestOtherA-611322616 None] Acquiring lock "cinder-quobyte-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06f373cc-1aa6-4e8f-b1ed-ecffa8b2e3a9 tempest-ServerActionsTestOtherA-611322616 None] Lock "cinder-quobyte-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2" acquired by "delete_volume" :: waited 0.031s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1a5f04-12bc-446c-a341-4553f95f7e2e]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-06f373cc-1aa6-4e8f-b1ed-ecffa8b2e3a9 tempest-ServerActionsTestOtherA-611322616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:54 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2 Sep 07 13:49:54 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:54 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-07a3f06c-87f6-4c93-b78a-b44f66cad129 tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313 1G" returned: 0 in 0.500s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-07a3f06c-87f6-4c93-b78a-b44f66cad129 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:54 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313 Sep 07 13:49:54 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:55 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-06f373cc-1aa6-4e8f-b1ed-ecffa8b2e3a9 tempest-ServerActionsTestOtherA-611322616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2" returned: 0 in 0.432s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-06f373cc-1aa6-4e8f-b1ed-ecffa8b2e3a9 tempest-ServerActionsTestOtherA-611322616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:55 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2 Sep 07 13:49:55 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:55 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-07a3f06c-87f6-4c93-b78a-b44f66cad129 tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313" returned: 0 in 0.381s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:55 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-07a3f06c-87f6-4c93-b78a-b44f66cad129 tempest-VolumesDeleteCascade-1249194852 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313 is being set with open permissions: ugo+rw Sep 07 13:49:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-07a3f06c-87f6-4c93-b78a-b44f66cad129 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:55 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313 Sep 07 13:49:55 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:55 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-06f373cc-1aa6-4e8f-b1ed-ecffa8b2e3a9 tempest-ServerActionsTestOtherA-611322616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2" returned: 0 in 0.336s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06f373cc-1aa6-4e8f-b1ed-ecffa8b2e3a9 tempest-ServerActionsTestOtherA-611322616 None] Lock "cinder-quobyte-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2" released by "delete_volume" :: held 0.848s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:55 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-06f373cc-1aa6-4e8f-b1ed-ecffa8b2e3a9 tempest-ServerActionsTestOtherA-611322616 None] Created reservations ['541694bf-c3b2-4a38-be9d-f29bf4b05bca', '2e69da46-a2f4-48de-8fd2-40ef0672aab8', 'ae5d9f23-17d5-4bff-816d-a4f5a1ceb9e7', '89ff21fb-c54d-4bd1-937d-49ab34704b11'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:55 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-07a3f06c-87f6-4c93-b78a-b44f66cad129 tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313" returned: 0 in 0.321s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-06f373cc-1aa6-4e8f-b1ed-ecffa8b2e3a9 tempest-ServerActionsTestOtherA-611322616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-06f373cc-1aa6-4e8f-b1ed-ecffa8b2e3a9 tempest-ServerActionsTestOtherA-611322616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-06f373cc-1aa6-4e8f-b1ed-ecffa8b2e3a9 tempest-ServerActionsTestOtherA-611322616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-06f373cc-1aa6-4e8f-b1ed-ecffa8b2e3a9 tempest-ServerActionsTestOtherA-611322616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-06f373cc-1aa6-4e8f-b1ed-ecffa8b2e3a9 tempest-ServerActionsTestOtherA-611322616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-06f373cc-1aa6-4e8f-b1ed-ecffa8b2e3a9 tempest-ServerActionsTestOtherA-611322616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-07a3f06c-87f6-4c93-b78a-b44f66cad129 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:55 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:49:55 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:55 devstack sudo[95976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.info Sep 07 13:49:55 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:56 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-07a3f06c-87f6-4c93-b78a-b44f66cad129 tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.info" returned: 0 in 0.445s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:56 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:56 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-07a3f06c-87f6-4c93-b78a-b44f66cad129 tempest-VolumesDeleteCascade-1249194852 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.info is being set with open permissions: ugo+rw Sep 07 13:49:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-07a3f06c-87f6-4c93-b78a-b44f66cad129 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-06f373cc-1aa6-4e8f-b1ed-ecffa8b2e3a9 tempest-ServerActionsTestOtherA-611322616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.504s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:56 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-06f373cc-1aa6-4e8f-b1ed-ecffa8b2e3a9 tempest-ServerActionsTestOtherA-611322616 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:49:56 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-06f373cc-1aa6-4e8f-b1ed-ecffa8b2e3a9 tempest-ServerActionsTestOtherA-611322616 None] Deleted volume successfully. Sep 07 13:49:56 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.info Sep 07 13:49:56 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06f373cc-1aa6-4e8f-b1ed-ecffa8b2e3a9 tempest-ServerActionsTestOtherA-611322616 None] Lock "cinder-9d3cfbae-a7e0-4743-b4e5-334d8abd71d2-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:56 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-07a3f06c-87f6-4c93-b78a-b44f66cad129 tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.info" returned: 0 in 0.479s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-07a3f06c-87f6-4c93-b78a-b44f66cad129 tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.829s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:56 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-07a3f06c-87f6-4c93-b78a-b44f66cad129 tempest-VolumesDeleteCascade-1249194852 None] Create snapshot completed successfully Sep 07 13:49:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-81d2e297-0a3e-41b8-9a4d-21e32bd26789 tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-81d2e297-0a3e-41b8-9a4d-21e32bd26789 tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-81d2e297-0a3e-41b8-9a4d-21e32bd26789 tempest-VolumesDeleteCascade-1249194852 None] Creating offline snapshot 3b50faa4-e5de-4f29-84e0-a54096422f8f of volume 6aef549c-5fd1-4e9a-95bf-b8419ee57867 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:49:57 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[756b21d6-dba7-4506-9a91-61b27a374306]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-81d2e297-0a3e-41b8-9a4d-21e32bd26789 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:57 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313 Sep 07 13:49:57 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:57 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-81d2e297-0a3e-41b8-9a4d-21e32bd26789 tempest-VolumesDeleteCascade-1249194852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313" returned: 0 in 0.467s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-81d2e297-0a3e-41b8-9a4d-21e32bd26789 tempest-VolumesDeleteCascade-1249194852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:49:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-81d2e297-0a3e-41b8-9a4d-21e32bd26789 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:57 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f 1G Sep 07 13:49:57 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:58 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-81d2e297-0a3e-41b8-9a4d-21e32bd26789 tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f 1G" returned: 0 in 0.648s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-81d2e297-0a3e-41b8-9a4d-21e32bd26789 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:58 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f Sep 07 13:49:58 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:58 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-81d2e297-0a3e-41b8-9a4d-21e32bd26789 tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f" returned: 0 in 0.428s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:58 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-81d2e297-0a3e-41b8-9a4d-21e32bd26789 tempest-VolumesDeleteCascade-1249194852 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f is being set with open permissions: ugo+rw Sep 07 13:49:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-81d2e297-0a3e-41b8-9a4d-21e32bd26789 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:58 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f Sep 07 13:49:58 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:59 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-81d2e297-0a3e-41b8-9a4d-21e32bd26789 tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f" returned: 0 in 0.345s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-81d2e297-0a3e-41b8-9a4d-21e32bd26789 tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:59 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-81d2e297-0a3e-41b8-9a4d-21e32bd26789 tempest-VolumesDeleteCascade-1249194852 None] Create snapshot completed successfully Sep 07 13:50:00 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "cinder-6aef549c-5fd1-4e9a-95bf-b8419ee57867-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:00 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-6aef549c-5fd1-4e9a-95bf-b8419ee57867-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Performing cascade delete. {{(pid=87571) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 07 13:50:00 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "cinder-1174ccb5-923c-4d84-b74b-a6d6ecc40313-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:00 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-1174ccb5-923c-4d84-b74b-a6d6ecc40313-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:00 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "cinder-quobyte-6aef549c-5fd1-4e9a-95bf-b8419ee57867" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:00 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-quobyte-6aef549c-5fd1-4e9a-95bf-b8419ee57867" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:00 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "cinder-quobyte-1174ccb5-923c-4d84-b74b-a6d6ecc40313" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:00 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-quobyte-1174ccb5-923c-4d84-b74b-a6d6ecc40313" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:00 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Deleting offline snapshot 1174ccb5-923c-4d84-b74b-a6d6ecc40313 of volume 6aef549c-5fd1-4e9a-95bf-b8419ee57867 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:50:00 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] snapshot_file for this snap is: volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:50:00 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[95044b0e-91fb-475a-a7a6-b5d84e52a58b]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:00 devstack sudo[96033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313 Sep 07 13:50:00 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:01 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313" returned: 0 in 0.509s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cd61f2-ee90-479f-9a1a-b3bb88aa4e08]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:01 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 Sep 07 13:50:01 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Flow 'volume_create_manager' (4522b5c4-45de-4fb5-a8cf-bba3409fe9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46368bd3-2dbe-4bd3-a419-1e07bd1681dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46368bd3-2dbe-4bd3-a419-1e07bd1681dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-160651148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c5914a-283b-4786-8279-24cda8e28a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20574c041a3345b0a91252909e00e11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:02Z,use_quota=True,user_id='8883b3665ba14fa590ebebd64ba41aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8541af-933a-4bc1-aaa0-a6cc309941cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8541af-933a-4bc1-aaa0-a6cc309941cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ce20ed-1aa6-4aad-b332-44456569b541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ce20ed-1aa6-4aad-b332-44456569b541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10c5914a-283b-4786-8279-24cda8e28a16', 'volume_name': 'volume-10c5914a-283b-4786-8279-24cda8e28a16', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df99aa23-578c-4b10-bcb3-b6c7c8cf7b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df99aa23-578c-4b10-bcb3-b6c7c8cf7b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d84e9f-7b82-4ecd-9415-f2e0c972947a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:01 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Volume 10c5914a-283b-4786-8279-24cda8e28a16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10c5914a-283b-4786-8279-24cda8e28a16', 'volume_size': 1} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-160651148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c5914a-283b-4786-8279-24cda8e28a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20574c041a3345b0a91252909e00e11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:02Z,use_quota=True,user_id='8883b3665ba14fa590ebebd64ba41aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Creating volume 10c5914a-283b-4786-8279-24cda8e28a16 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:50:01 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-10c5914a-283b-4786-8279-24cda8e28a16 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:01 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-10c5914a-283b-4786-8279-24cda8e28a16 1073741824 Sep 07 13:50:01 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:01 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867" returned: 0 in 0.565s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04a13da-1ede-4b12-89ef-67ff90625906]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:02 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f Sep 07 13:50:02 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:02 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:02 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-10c5914a-283b-4786-8279-24cda8e28a16 1073741824" returned: 0 in 0.546s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f" returned: 0 in 0.445s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:50:02 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a30dfd-29f5-49cf-8902-bd845773f72f]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-10c5914a-283b-4786-8279-24cda8e28a16 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:02 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-10c5914a-283b-4786-8279-24cda8e28a16 Sep 07 13:50:02 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:02 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313 Sep 07 13:50:02 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:02 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-10c5914a-283b-4786-8279-24cda8e28a16" returned: 0 in 0.432s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:50:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d84e9f-7b82-4ecd-9415-f2e0c972947a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10c5914a-283b-4786-8279-24cda8e28a16', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd5aae1b-a163-4ef3-9876-6498fc6a2787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:02 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313" returned: 0 in 0.517s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:50:02 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Volume volume-10c5914a-283b-4786-8279-24cda8e28a16 (10c5914a-283b-4786-8279-24cda8e28a16): created successfully Sep 07 13:50:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd5aae1b-a163-4ef3-9876-6498fc6a2787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Flow 'volume_create_manager' (4522b5c4-45de-4fb5-a8cf-bba3409fe9af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:03 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[732d0f27-c318-46ef-9c34-b6bb4afa267b]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:03 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-52e21ba7-edc6-41fa-94e7-1fb0754a4ef6 tempest-AbsoluteLimitsTests-1766007836 None] Created volume successfully. Sep 07 13:50:03 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 Sep 07 13:50:03 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:03 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867" returned: 0 in 0.431s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:03 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313 Sep 07 13:50:03 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:03 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313" returned: 0 in 0.425s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:03 devstack sudo[96116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313 Sep 07 13:50:03 devstack sudo[96116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-978169bf-d2bc-4592-8efa-da153ed33ec7 tempest-AbsoluteLimitsTests-1766007836 None] Acquiring lock "cinder-10c5914a-283b-4786-8279-24cda8e28a16-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-978169bf-d2bc-4592-8efa-da153ed33ec7 tempest-AbsoluteLimitsTests-1766007836 None] Lock "cinder-10c5914a-283b-4786-8279-24cda8e28a16-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-978169bf-d2bc-4592-8efa-da153ed33ec7 tempest-AbsoluteLimitsTests-1766007836 None] Acquiring lock "cinder-quobyte-10c5914a-283b-4786-8279-24cda8e28a16" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-978169bf-d2bc-4592-8efa-da153ed33ec7 tempest-AbsoluteLimitsTests-1766007836 None] Lock "cinder-quobyte-10c5914a-283b-4786-8279-24cda8e28a16" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:04 devstack sudo[96116]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.1174ccb5-923c-4d84-b74b-a6d6ecc40313" returned: 0 in 0.382s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f -F qcow2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:04 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd4029d-cefd-4e61-9f3e-70739760cef0]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-978169bf-d2bc-4592-8efa-da153ed33ec7 tempest-AbsoluteLimitsTests-1766007836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-10c5914a-283b-4786-8279-24cda8e28a16 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:04 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f -F qcow2 Sep 07 13:50:04 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:04 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-10c5914a-283b-4786-8279-24cda8e28a16 Sep 07 13:50:04 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:04 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f -F qcow2" returned: 0 in 0.409s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:04 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-quobyte-1174ccb5-923c-4d84-b74b-a6d6ecc40313" released by "_delete_snapshot" :: held 3.946s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-978169bf-d2bc-4592-8efa-da153ed33ec7 tempest-AbsoluteLimitsTests-1766007836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-10c5914a-283b-4786-8279-24cda8e28a16" returned: 0 in 0.443s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-978169bf-d2bc-4592-8efa-da153ed33ec7 tempest-AbsoluteLimitsTests-1766007836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-10c5914a-283b-4786-8279-24cda8e28a16 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-quobyte-6aef549c-5fd1-4e9a-95bf-b8419ee57867" released by "delete_snapshot" :: held 4.005s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:04 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-10c5914a-283b-4786-8279-24cda8e28a16 Sep 07 13:50:04 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:04 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Created reservations ['f17c6741-3f1a-4b06-a3a7-3fe6f9ccde44', '9ba49db6-ee2a-482a-814f-c8736c2efbfe', '4708c42d-da9f-4995-afde-9247d114fd4a', '31fb685f-f06e-41ac-a73f-d2ca23d2a0c2'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:04 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Delete snapshot completed successfully. Sep 07 13:50:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-1174ccb5-923c-4d84-b74b-a6d6ecc40313-delete_snapshot" released by "delete_snapshot" :: held 4.230s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "cinder-3b50faa4-e5de-4f29-84e0-a54096422f8f-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-3b50faa4-e5de-4f29-84e0-a54096422f8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "cinder-quobyte-6aef549c-5fd1-4e9a-95bf-b8419ee57867" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-quobyte-6aef549c-5fd1-4e9a-95bf-b8419ee57867" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "cinder-quobyte-3b50faa4-e5de-4f29-84e0-a54096422f8f" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-quobyte-3b50faa4-e5de-4f29-84e0-a54096422f8f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Deleting offline snapshot 3b50faa4-e5de-4f29-84e0-a54096422f8f of volume 6aef549c-5fd1-4e9a-95bf-b8419ee57867 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:50:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] snapshot_file for this snap is: volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:50:05 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-978169bf-d2bc-4592-8efa-da153ed33ec7 tempest-AbsoluteLimitsTests-1766007836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-10c5914a-283b-4786-8279-24cda8e28a16" returned: 0 in 0.309s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:05 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a3c693-1488-44ff-a463-daf46eeb8fa3]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-978169bf-d2bc-4592-8efa-da153ed33ec7 tempest-AbsoluteLimitsTests-1766007836 None] Lock "cinder-quobyte-10c5914a-283b-4786-8279-24cda8e28a16" released by "delete_volume" :: held 0.805s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:05 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-978169bf-d2bc-4592-8efa-da153ed33ec7 tempest-AbsoluteLimitsTests-1766007836 None] Created reservations ['f4d9a746-79af-4307-8639-3ca1dd8ef083', '025e2371-6ce0-4382-a32c-621440f3bf58', '89dae8e5-f976-4124-98d6-67b209db28ee', 'ccce8202-51f2-439c-abb0-8b8b81e22b08'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:05 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f Sep 07 13:50:05 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-978169bf-d2bc-4592-8efa-da153ed33ec7 tempest-AbsoluteLimitsTests-1766007836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-978169bf-d2bc-4592-8efa-da153ed33ec7 tempest-AbsoluteLimitsTests-1766007836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-978169bf-d2bc-4592-8efa-da153ed33ec7 tempest-AbsoluteLimitsTests-1766007836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-978169bf-d2bc-4592-8efa-da153ed33ec7 tempest-AbsoluteLimitsTests-1766007836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-978169bf-d2bc-4592-8efa-da153ed33ec7 tempest-AbsoluteLimitsTests-1766007836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-978169bf-d2bc-4592-8efa-da153ed33ec7 tempest-AbsoluteLimitsTests-1766007836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:05 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:50:05 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:05 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-978169bf-d2bc-4592-8efa-da153ed33ec7 tempest-AbsoluteLimitsTests-1766007836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.333s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:05 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-978169bf-d2bc-4592-8efa-da153ed33ec7 tempest-AbsoluteLimitsTests-1766007836 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:50:05 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-978169bf-d2bc-4592-8efa-da153ed33ec7 tempest-AbsoluteLimitsTests-1766007836 None] Deleted volume successfully. Sep 07 13:50:05 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f" returned: 0 in 0.534s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:50:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-978169bf-d2bc-4592-8efa-da153ed33ec7 tempest-AbsoluteLimitsTests-1766007836 None] Lock "cinder-10c5914a-283b-4786-8279-24cda8e28a16-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:05 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[af32fdd1-bcd7-402a-8dcc-b98be6cc59df]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:05 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 Sep 07 13:50:05 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:06 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867" returned: 0 in 0.544s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:06 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f Sep 07 13:50:06 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:06 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f" returned: 0 in 0.490s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:06 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f Sep 07 13:50:06 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:07 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867.3b50faa4-e5de-4f29-84e0-a54096422f8f" returned: 0 in 0.394s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:07 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-quobyte-3b50faa4-e5de-4f29-84e0-a54096422f8f" released by "_delete_snapshot" :: held 2.088s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:07 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-quobyte-6aef549c-5fd1-4e9a-95bf-b8419ee57867" released by "delete_snapshot" :: held 2.114s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:07 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Created reservations ['13b8d701-b7aa-4377-98b2-572e680b9c06', '9ce347fd-5679-40dc-bc04-291a73eb7232', 'aabf7230-c2f5-4be9-9517-b4205ff76607', 'e50752ad-95a4-4aa9-aa44-2f5eedf50418'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:07 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Delete snapshot completed successfully. Sep 07 13:50:07 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-3b50faa4-e5de-4f29-84e0-a54096422f8f-delete_snapshot" released by "delete_snapshot" :: held 2.362s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Snapshots deleted, issuing volume delete {{(pid=87571) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 07 13:50:07 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "cinder-quobyte-6aef549c-5fd1-4e9a-95bf-b8419ee57867" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:07 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-quobyte-6aef549c-5fd1-4e9a-95bf-b8419ee57867" acquired by "delete_volume" :: waited 0.035s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:07 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f46e02-8e81-43f0-af2e-7c5a97639bdd]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:07 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 Sep 07 13:50:07 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:07 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867" returned: 0 in 0.533s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:07 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867 Sep 07 13:50:07 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:08 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6aef549c-5fd1-4e9a-95bf-b8419ee57867" returned: 0 in 0.288s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-quobyte-6aef549c-5fd1-4e9a-95bf-b8419ee57867" released by "delete_volume" :: held 0.904s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:08 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Created reservations ['8658537c-2967-4dde-9e2c-483c0c976ab8', '7734b3ae-614e-4c65-a1b1-95381c2629d4', '2a6923c2-550e-4e7b-b2bc-3a7766187fb8', '1a372ee4-57cd-420e-a58a-1aa4ae0aa85d'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:08 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:08 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:08 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:50:08 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:08 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.332s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:08 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:50:08 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Deleted volume successfully. Sep 07 13:50:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-78e3a0b7-8ea4-4065-8550-ffbd413acc9a tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-6aef549c-5fd1-4e9a-95bf-b8419ee57867-delete_volume" released by "delete_volume" :: held 8.217s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=133,cinder:UPDATE=168,cinder:INSERT=36,cinder:DELETE=12 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=125,cinder:UPDATE=158,cinder:INSERT=43,cinder:DELETE=15 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Flow 'volume_create_manager' (e8b1c78f-adde-4e75-adc2-52d7707b5abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c2b1cb-516a-4316-89e6-b594886cfa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c2b1cb-516a-4316-89e6-b594886cfa8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1978758097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f732ee-e60e-49f6-a6ce-9f79902d0334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e81b8dd6e1c427f902e5a2c4213101d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:10Z,use_quota=True,user_id='e0be20a57ecb46588904af7a98fce629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54531a91-794c-46d8-9cb2-4a42e3c14973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54531a91-794c-46d8-9cb2-4a42e3c14973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f191f56-2f73-48f9-bac6-07759fc5e1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f191f56-2f73-48f9-bac6-07759fc5e1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52f732ee-e60e-49f6-a6ce-9f79902d0334', 'volume_name': 'volume-52f732ee-e60e-49f6-a6ce-9f79902d0334', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26238c26-4d5a-4b4c-9d21-08a843f91922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26238c26-4d5a-4b4c-9d21-08a843f91922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b753463d-0805-4f1b-b794-6d75fabe7a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:09 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Volume 52f732ee-e60e-49f6-a6ce-9f79902d0334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52f732ee-e60e-49f6-a6ce-9f79902d0334', 'volume_size': 1} Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1978758097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f732ee-e60e-49f6-a6ce-9f79902d0334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e81b8dd6e1c427f902e5a2c4213101d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:10Z,use_quota=True,user_id='e0be20a57ecb46588904af7a98fce629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Creating volume 52f732ee-e60e-49f6-a6ce-9f79902d0334 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:50:09 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:50:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:09 devstack sudo[96171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334 1073741824 Sep 07 13:50:09 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:10 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334 1073741824" returned: 0 in 0.547s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:10 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334 Sep 07 13:50:10 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:10 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334" returned: 0 in 0.311s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:50:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b753463d-0805-4f1b-b794-6d75fabe7a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52f732ee-e60e-49f6-a6ce-9f79902d0334', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52dc56b5-d2fd-474e-8634-d56c45c52d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:10 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Volume volume-52f732ee-e60e-49f6-a6ce-9f79902d0334 (52f732ee-e60e-49f6-a6ce-9f79902d0334): created successfully Sep 07 13:50:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52dc56b5-d2fd-474e-8634-d56c45c52d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Flow 'volume_create_manager' (e8b1c78f-adde-4e75-adc2-52d7707b5abb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:10 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-893fdc2a-c01d-48b1-85e6-4b61e17a7e99 tempest-VolumesDeleteCascade-1249194852 None] Created volume successfully. Sep 07 13:50:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-325f15ae-f659-4dfe-ab6f-3eccebb9a161 tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-325f15ae-f659-4dfe-ab6f-3eccebb9a161 tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-325f15ae-f659-4dfe-ab6f-3eccebb9a161 tempest-VolumesDeleteCascade-1249194852 None] Creating offline snapshot a64ade29-0557-48a4-82ce-d64e25078f8b of volume 52f732ee-e60e-49f6-a6ce-9f79902d0334 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:50:12 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[818096aa-84f5-4e77-842f-8a1462915de4]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-325f15ae-f659-4dfe-ab6f-3eccebb9a161 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:12 devstack sudo[96182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334 Sep 07 13:50:12 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:12 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-325f15ae-f659-4dfe-ab6f-3eccebb9a161 tempest-VolumesDeleteCascade-1249194852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334" returned: 0 in 0.440s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-325f15ae-f659-4dfe-ab6f-3eccebb9a161 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.a64ade29-0557-48a4-82ce-d64e25078f8b 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:12 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.a64ade29-0557-48a4-82ce-d64e25078f8b 1G Sep 07 13:50:12 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:13 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:50:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Flow 'volume_create_manager' (812282a4-1814-47d6-9501-9b7c5115173c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34bdee16-eded-430c-80fa-8569ef1a0b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34bdee16-eded-430c-80fa-8569ef1a0b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-995002327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cbf1497-9b95-467e-b39d-fe701e6fda11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91c20d62af9343fc8af866b5ab5f12f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:13Z,use_quota=True,user_id='9aa7ef82129646e4ac06bb39c274c6a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ef8931-3e72-43b4-8873-92afc1c2fc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ef8931-3e72-43b4-8873-92afc1c2fc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982cd3af-ffd8-44f3-afce-e7d3eb88b1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982cd3af-ffd8-44f3-afce-e7d3eb88b1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cbf1497-9b95-467e-b39d-fe701e6fda11', 'volume_name': 'volume-1cbf1497-9b95-467e-b39d-fe701e6fda11', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8231f433-89ea-4ed5-b39b-e310cd87b80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8231f433-89ea-4ed5-b39b-e310cd87b80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f1e2c3-7a5b-404c-92a5-dc7f1bf8b752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:13 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Volume 1cbf1497-9b95-467e-b39d-fe701e6fda11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cbf1497-9b95-467e-b39d-fe701e6fda11', 'volume_size': 1} Sep 07 13:50:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:13 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-325f15ae-f659-4dfe-ab6f-3eccebb9a161 tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.a64ade29-0557-48a4-82ce-d64e25078f8b 1G" returned: 0 in 0.571s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-325f15ae-f659-4dfe-ab6f-3eccebb9a161 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52f732ee-e60e-49f6-a6ce-9f79902d0334 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.a64ade29-0557-48a4-82ce-d64e25078f8b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:13 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52f732ee-e60e-49f6-a6ce-9f79902d0334 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.a64ade29-0557-48a4-82ce-d64e25078f8b Sep 07 13:50:13 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:13 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-325f15ae-f659-4dfe-ab6f-3eccebb9a161 tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52f732ee-e60e-49f6-a6ce-9f79902d0334 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.a64ade29-0557-48a4-82ce-d64e25078f8b" returned: 0 in 0.339s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:13 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-325f15ae-f659-4dfe-ab6f-3eccebb9a161 tempest-VolumesDeleteCascade-1249194852 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.a64ade29-0557-48a4-82ce-d64e25078f8b is being set with open permissions: ugo+rw Sep 07 13:50:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-325f15ae-f659-4dfe-ab6f-3eccebb9a161 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.a64ade29-0557-48a4-82ce-d64e25078f8b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:13 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.a64ade29-0557-48a4-82ce-d64e25078f8b Sep 07 13:50:13 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:13 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-325f15ae-f659-4dfe-ab6f-3eccebb9a161 tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.a64ade29-0557-48a4-82ce-d64e25078f8b" returned: 0 in 0.264s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-325f15ae-f659-4dfe-ab6f-3eccebb9a161 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:13 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.info Sep 07 13:50:13 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:14 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-325f15ae-f659-4dfe-ab6f-3eccebb9a161 tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.info" returned: 0 in 0.312s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:14 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-325f15ae-f659-4dfe-ab6f-3eccebb9a161 tempest-VolumesDeleteCascade-1249194852 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.info is being set with open permissions: ugo+rw Sep 07 13:50:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-325f15ae-f659-4dfe-ab6f-3eccebb9a161 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:14 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.info Sep 07 13:50:14 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:14 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-325f15ae-f659-4dfe-ab6f-3eccebb9a161 tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.info" returned: 0 in 0.296s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-325f15ae-f659-4dfe-ab6f-3eccebb9a161 tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.364s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.342s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-995002327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cbf1497-9b95-467e-b39d-fe701e6fda11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91c20d62af9343fc8af866b5ab5f12f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:13Z,use_quota=True,user_id='9aa7ef82129646e4ac06bb39c274c6a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:50:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Creating volume 1cbf1497-9b95-467e-b39d-fe701e6fda11 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:50:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:50:14 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:50:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1cbf1497-9b95-467e-b39d-fe701e6fda11 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:14 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1cbf1497-9b95-467e-b39d-fe701e6fda11 1073741824 Sep 07 13:50:14 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:14 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-325f15ae-f659-4dfe-ab6f-3eccebb9a161 tempest-VolumesDeleteCascade-1249194852 None] Create snapshot completed successfully Sep 07 13:50:15 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1cbf1497-9b95-467e-b39d-fe701e6fda11 1073741824" returned: 0 in 0.610s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1cbf1497-9b95-467e-b39d-fe701e6fda11 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:15 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1cbf1497-9b95-467e-b39d-fe701e6fda11 Sep 07 13:50:15 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:15 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1cbf1497-9b95-467e-b39d-fe701e6fda11" returned: 0 in 0.286s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:50:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f1e2c3-7a5b-404c-92a5-dc7f1bf8b752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cbf1497-9b95-467e-b39d-fe701e6fda11', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8d7053-ce6a-45f0-be22-0395bd477b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:15 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Volume volume-1cbf1497-9b95-467e-b39d-fe701e6fda11 (1cbf1497-9b95-467e-b39d-fe701e6fda11): created successfully Sep 07 13:50:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8d7053-ce6a-45f0-be22-0395bd477b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Flow 'volume_create_manager' (812282a4-1814-47d6-9501-9b7c5115173c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:15 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-0e1062ed-ffd4-43fb-baa4-7ff869d60120 tempest-VolumesMetadataTest-2120334311 None] Created volume successfully. Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Flow 'volume_create_manager' (f48d3b29-43e1-441e-8918-9a54fc7efd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (486812e4-b759-44aa-b1d6-2dc7dc789446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (486812e4-b759-44aa-b1d6-2dc7dc789446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-248953859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e81b8dd6e1c427f902e5a2c4213101d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a64ade29-0557-48a4-82ce-d64e25078f8b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:16Z,use_quota=True,user_id='e0be20a57ecb46588904af7a98fce629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea900acc-e7fb-4467-8ce1-42a25e651f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea900acc-e7fb-4467-8ce1-42a25e651f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5384e845-e2e8-4d77-8238-d4522417b80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5384e845-e2e8-4d77-8238-d4522417b80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d', 'volume_name': 'volume-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d', 'volume_size': 1, 'snapshot_id': 'a64ade29-0557-48a4-82ce-d64e25078f8b'}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63694117-3d78-4091-82d7-daa4344e15d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63694117-3d78-4091-82d7-daa4344e15d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64bff073-ed2e-4cd0-a4e8-a3d5537a63e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:16 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Volume 0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d', 'volume_size': 1, 'snapshot_id': 'a64ade29-0557-48a4-82ce-d64e25078f8b'} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "cinder-quobyte-a64ade29-0557-48a4-82ce-d64e25078f8b-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d" by "_create_volume_from_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-quobyte-a64ade29-0557-48a4-82ce-d64e25078f8b-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Creating volume 0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d from snapshot a64ade29-0557-48a4-82ce-d64e25078f8b {{(pid=87571) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "cinder-quobyte-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d" by "_copy_volume_from_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-quobyte-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] snapshot: a64ade29-0557-48a4-82ce-d64e25078f8b, volume: 0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d, {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5cd1fb-0f6c-4270-978a-9ae0816e39ea]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.a64ade29-0557-48a4-82ce-d64e25078f8b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:16 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.a64ade29-0557-48a4-82ce-d64e25078f8b Sep 07 13:50:16 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:16 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.a64ade29-0557-48a4-82ce-d64e25078f8b" returned: 0 in 0.569s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52f732ee-e60e-49f6-a6ce-9f79902d0334(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[796d3a2f-7faa-442b-bfb7-04f945e1d52c]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:16 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334 Sep 07 13:50:16 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:17 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334" returned: 0 in 0.567s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334 {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Creating direct copy from snapshot {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG cinder.utils [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Path /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d not found in is_blk_device check {{(pid=87571) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:17 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d Sep 07 13:50:17 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Flow 'volume_create_manager' (e6f23cfc-26ab-43e0-a63d-492ed253627e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3633047c-c454-4acc-a73c-77861660688f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3633047c-c454-4acc-a73c-77861660688f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1270706845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149130ce-7077-4f3a-a170-ad65573c3d67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5e8835c78f49738318b8be3cdd0e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:17Z,use_quota=True,user_id='a7b371bb0cf547b1ada76be1737187f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb2b41e-0fcd-4f69-a668-2d0ffefc8198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb2b41e-0fcd-4f69-a668-2d0ffefc8198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5a2186-f044-4f37-8fcc-aba7bc523da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG cinder.image.glance [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Creating Keystone auth plugin from conf {{(pid=87571) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6eb80d46-ee9f-466a-b41e-5b1575a11ef9 tempest-VolumesMetadataTest-2120334311 None] Acquiring lock "cinder-1cbf1497-9b95-467e-b39d-fe701e6fda11-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6eb80d46-ee9f-466a-b41e-5b1575a11ef9 tempest-VolumesMetadataTest-2120334311 None] Lock "cinder-1cbf1497-9b95-467e-b39d-fe701e6fda11-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6eb80d46-ee9f-466a-b41e-5b1575a11ef9 tempest-VolumesMetadataTest-2120334311 None] Acquiring lock "cinder-quobyte-1cbf1497-9b95-467e-b39d-fe701e6fda11" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6eb80d46-ee9f-466a-b41e-5b1575a11ef9 tempest-VolumesMetadataTest-2120334311 None] Lock "cinder-quobyte-1cbf1497-9b95-467e-b39d-fe701e6fda11" acquired by "delete_volume" :: waited 0.029s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfdabd8-46d7-4111-abf5-60d87129ad20]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6eb80d46-ee9f-466a-b41e-5b1575a11ef9 tempest-VolumesMetadataTest-2120334311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1cbf1497-9b95-467e-b39d-fe701e6fda11 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5a2186-f044-4f37-8fcc-aba7bc523da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '149130ce-7077-4f3a-a170-ad65573c3d67', 'volume_name': 'volume-149130ce-7077-4f3a-a170-ad65573c3d67', 'volume_size': 1, 'image_id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d9d2114dd14b01a04867c896fdabaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'created_at': datetime.datetime(2026, 9, 7, 11, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdbd1541-2076-47bf-b26a-15662727e644/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16999494-edb2-4107-85db-2b30f3590c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16999494-edb2-4107-85db-2b30f3590c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a0ab31-e0df-4428-8dd9-017b8ea3c03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:17 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Volume 149130ce-7077-4f3a-a170-ad65573c3d67: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-149130ce-7077-4f3a-a170-ad65573c3d67', 'volume_size': 1, 'image_id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d9d2114dd14b01a04867c896fdabaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'created_at': datetime.datetime(2026, 9, 7, 11, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdbd1541-2076-47bf-b26a-15662727e644/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 13:50:17 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Trying to clone 149130ce-7077-4f3a-a170-ad65573c3d67 from image bdbd1541-2076-47bf-b26a-15662727e644 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}]). {{(pid=87571) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1099}} Sep 07 13:50:17 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1cbf1497-9b95-467e-b39d-fe701e6fda11 Sep 07 13:50:17 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:18 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6eb80d46-ee9f-466a-b41e-5b1575a11ef9 tempest-VolumesMetadataTest-2120334311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1cbf1497-9b95-467e-b39d-fe701e6fda11" returned: 0 in 0.716s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6eb80d46-ee9f-466a-b41e-5b1575a11ef9 tempest-VolumesMetadataTest-2120334311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1cbf1497-9b95-467e-b39d-fe701e6fda11 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:18 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1cbf1497-9b95-467e-b39d-fe701e6fda11 Sep 07 13:50:18 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:18 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bo_7jxrddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 13:50:18 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Image download 20.69 MB at 20.69 MB/s Sep 07 13:50:19 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0b90bf-31f9-4cf6-a979-b732bffe21c5]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bo_7jxrddevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:19 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6eb80d46-ee9f-466a-b41e-5b1575a11ef9 tempest-VolumesMetadataTest-2120334311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1cbf1497-9b95-467e-b39d-fe701e6fda11" returned: 0 in 0.683s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6eb80d46-ee9f-466a-b41e-5b1575a11ef9 tempest-VolumesMetadataTest-2120334311 None] Lock "cinder-quobyte-1cbf1497-9b95-467e-b39d-fe701e6fda11" released by "delete_volume" :: held 1.491s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:19 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-6eb80d46-ee9f-466a-b41e-5b1575a11ef9 tempest-VolumesMetadataTest-2120334311 None] Created reservations ['5b28bec3-124d-4285-9d88-b3da726108a7', '65762e47-db8a-4187-be54-2fee3806eed0', '19813871-1371-40d4-b0cd-b83c5838845c', 'a7f285d2-e16b-4150-96bc-c6c2aa7d0ab2'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:19 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bo_7jxrddevstack@QuobyteHD Sep 07 13:50:19 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6eb80d46-ee9f-466a-b41e-5b1575a11ef9 tempest-VolumesMetadataTest-2120334311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6eb80d46-ee9f-466a-b41e-5b1575a11ef9 tempest-VolumesMetadataTest-2120334311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:19 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-6eb80d46-ee9f-466a-b41e-5b1575a11ef9 tempest-VolumesMetadataTest-2120334311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:19 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-6eb80d46-ee9f-466a-b41e-5b1575a11ef9 tempest-VolumesMetadataTest-2120334311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6eb80d46-ee9f-466a-b41e-5b1575a11ef9 tempest-VolumesMetadataTest-2120334311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6eb80d46-ee9f-466a-b41e-5b1575a11ef9 tempest-VolumesMetadataTest-2120334311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:19 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:50:19 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:20 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6eb80d46-ee9f-466a-b41e-5b1575a11ef9 tempest-VolumesMetadataTest-2120334311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.488s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:20 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-6eb80d46-ee9f-466a-b41e-5b1575a11ef9 tempest-VolumesMetadataTest-2120334311 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:50:20 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-6eb80d46-ee9f-466a-b41e-5b1575a11ef9 tempest-VolumesMetadataTest-2120334311 None] Deleted volume successfully. Sep 07 13:50:20 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bo_7jxrddevstack@QuobyteHD" returned: 0 in 1.239s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:20 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Temporary image bdbd1541-2076-47bf-b26a-15662727e644 is fetched for user a7b371bb0cf547b1ada76be1737187f3. {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 13:50:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6eb80d46-ee9f-466a-b41e-5b1575a11ef9 tempest-VolumesMetadataTest-2120334311 None] Lock "cinder-1cbf1497-9b95-467e-b39d-fe701e6fda11-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:20 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d737decd-b46d-4b34-9b6d-9dd526c4d638]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bo_7jxrddevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:20 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bo_7jxrddevstack@QuobyteHD Sep 07 13:50:20 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:21 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bo_7jxrddevstack@QuobyteHD" returned: 0 in 1.169s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:23 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d" returned: 0 in 6.203s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:23 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:50:23 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Converted 1024.00 MB image at 165.06 MB/s Sep 07 13:50:23 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d is being set with open permissions: ugo+rw Sep 07 13:50:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:23 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d Sep 07 13:50:23 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:23 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d" returned: 0 in 0.272s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-quobyte-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d" released by "_copy_volume_from_snapshot" :: held 7.714s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-quobyte-a64ade29-0557-48a4-82ce-d64e25078f8b-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d" released by "_create_volume_from_snapshot" :: held 7.796s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.814s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.198s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1270706845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149130ce-7077-4f3a-a170-ad65573c3d67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5e8835c78f49738318b8be3cdd0e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:17Z,use_quota=True,user_id='a7b371bb0cf547b1ada76be1737187f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:50:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Creating volume 149130ce-7077-4f3a-a170-ad65573c3d67 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:50:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:50:23 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:50:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-149130ce-7077-4f3a-a170-ad65573c3d67 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:24 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-149130ce-7077-4f3a-a170-ad65573c3d67 1073741824 Sep 07 13:50:24 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64bff073-ed2e-4cd0-a4e8-a3d5537a63e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d', 'volume_size': 1, 'snapshot_id': 'a64ade29-0557-48a4-82ce-d64e25078f8b'}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c7ff146-e5b1-4071-82d3-d14af46055d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:24 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Volume volume-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d (0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d): created successfully Sep 07 13:50:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c7ff146-e5b1-4071-82d3-d14af46055d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Flow 'volume_create_manager' (f48d3b29-43e1-441e-8918-9a54fc7efd5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:24 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-311262e9-60fc-4587-a518-6e1773a4d17a tempest-VolumesDeleteCascade-1249194852 None] Created volume successfully. Sep 07 13:50:24 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "cinder-52f732ee-e60e-49f6-a6ce-9f79902d0334-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:24 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-52f732ee-e60e-49f6-a6ce-9f79902d0334-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Performing cascade delete. {{(pid=87571) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 07 13:50:24 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "cinder-a64ade29-0557-48a4-82ce-d64e25078f8b-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:24 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-a64ade29-0557-48a4-82ce-d64e25078f8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:24 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "cinder-quobyte-52f732ee-e60e-49f6-a6ce-9f79902d0334" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:24 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-quobyte-52f732ee-e60e-49f6-a6ce-9f79902d0334" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:24 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "cinder-quobyte-a64ade29-0557-48a4-82ce-d64e25078f8b" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:24 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-quobyte-a64ade29-0557-48a4-82ce-d64e25078f8b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Deleting offline snapshot a64ade29-0557-48a4-82ce-d64e25078f8b of volume 52f732ee-e60e-49f6-a6ce-9f79902d0334 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:50:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] snapshot_file for this snap is: volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.a64ade29-0557-48a4-82ce-d64e25078f8b {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:50:24 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4522811d-3072-4b9e-a898-bab4e332789f]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.a64ade29-0557-48a4-82ce-d64e25078f8b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:24 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-149130ce-7077-4f3a-a170-ad65573c3d67 1073741824" returned: 0 in 0.678s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-149130ce-7077-4f3a-a170-ad65573c3d67 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:24 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-149130ce-7077-4f3a-a170-ad65573c3d67 Sep 07 13:50:24 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:24 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.a64ade29-0557-48a4-82ce-d64e25078f8b Sep 07 13:50:24 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:25 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-149130ce-7077-4f3a-a170-ad65573c3d67" returned: 0 in 0.303s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:50:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:25 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Attempting download of bdbd1541-2076-47bf-b26a-15662727e644 ((None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}])) to volume 149130ce-7077-4f3a-a170-ad65573c3d67. {{(pid=87571) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 13:50:25 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.a64ade29-0557-48a4-82ce-d64e25078f8b" returned: 0 in 0.474s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52f732ee-e60e-49f6-a6ce-9f79902d0334(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:50:25 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f892298-6d05-4517-bf17-ca70ffac4b37]: (4, 'raw') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_guychjug {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:25 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db5a4f2-b1fc-4064-aa28-24ac355928c4]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:25 devstack sudo[96286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_guychjug Sep 07 13:50:25 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:25 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334 Sep 07 13:50:25 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:25 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_guychjug" returned: 0 in 0.371s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_guychjug {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:25 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_guychjug Sep 07 13:50:25 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:25 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334" returned: 0 in 0.601s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.a64ade29-0557-48a4-82ce-d64e25078f8b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:25 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.a64ade29-0557-48a4-82ce-d64e25078f8b Sep 07 13:50:25 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:25 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_guychjug" returned: 1 in 0.381s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_guychjug' failed. Not Retrying. {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 13:50:25 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed775b18-2331-42b9-a433-a24a04104327]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bo_7jxrddevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:26 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bo_7jxrddevstack@QuobyteHD Sep 07 13:50:26 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:26 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.a64ade29-0557-48a4-82ce-d64e25078f8b" returned: 0 in 0.420s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.a64ade29-0557-48a4-82ce-d64e25078f8b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:26 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.a64ade29-0557-48a4-82ce-d64e25078f8b Sep 07 13:50:26 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:26 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bo_7jxrddevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:26 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] bdbd1541-2076-47bf-b26a-15662727e644 was qcow2, converting to qcow2 {{(pid=87571) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 13:50:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bo_7jxrddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-149130ce-7077-4f3a-a170-ad65573c3d67 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:26 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bo_7jxrddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-149130ce-7077-4f3a-a170-ad65573c3d67 Sep 07 13:50:26 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:26 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334.a64ade29-0557-48a4-82ce-d64e25078f8b" returned: 0 in 0.300s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-quobyte-a64ade29-0557-48a4-82ce-d64e25078f8b" released by "_delete_snapshot" :: held 1.919s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-quobyte-52f732ee-e60e-49f6-a6ce-9f79902d0334" released by "delete_snapshot" :: held 1.944s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:26 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Created reservations ['a2a87578-12a5-4a80-8aa4-3c4a74501c00', '624a6a59-3e40-459c-bc36-4651dffd3358', 'eb4072ff-4eb3-464c-b0e8-62691ec5ee06', 'b726e9da-c4d4-49f9-a4b5-691af6daddd9'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:26 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Delete snapshot completed successfully. Sep 07 13:50:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-a64ade29-0557-48a4-82ce-d64e25078f8b-delete_snapshot" released by "delete_snapshot" :: held 2.295s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:26 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Snapshots deleted, issuing volume delete {{(pid=87571) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 07 13:50:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "cinder-quobyte-52f732ee-e60e-49f6-a6ce-9f79902d0334" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-quobyte-52f732ee-e60e-49f6-a6ce-9f79902d0334" acquired by "delete_volume" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:26 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59688a8-5566-4048-afd3-470eb1560457]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:27 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334 Sep 07 13:50:27 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:27 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334" returned: 0 in 0.581s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:27 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334 Sep 07 13:50:27 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Flow 'volume_create_manager' (6d4a89f3-99c6-4cf7-b274-b47435a13fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065be89f-2b4c-4efd-b6d5-d87b3b1a4abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065be89f-2b4c-4efd-b6d5-d87b3b1a4abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-261321294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='de354f77813047bfa0e9d4f3cd6b8ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:28Z,use_quota=True,user_id='a9a7e127c1df4212b6624d449e04ef22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2cca55-bc3b-4fdf-b1fb-a707e802a7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2cca55-bc3b-4fdf-b1fb-a707e802a7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c976fb8e-5c83-4874-bada-1e631385bd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c976fb8e-5c83-4874-bada-1e631385bd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1', 'volume_name': 'volume-842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2cf780d-21a2-4a8a-8ce8-35ae9603d579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2cf780d-21a2-4a8a-8ce8-35ae9603d579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7ad40b-03ed-4767-8707-096411e2b7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:27 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Volume 842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1', 'volume_size': 1} Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-261321294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='de354f77813047bfa0e9d4f3cd6b8ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:28Z,use_quota=True,user_id='a9a7e127c1df4212b6624d449e04ef22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Creating volume 842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:50:27 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:27 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1 1073741824 Sep 07 13:50:27 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:27 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-52f732ee-e60e-49f6-a6ce-9f79902d0334" returned: 0 in 0.383s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:27 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-quobyte-52f732ee-e60e-49f6-a6ce-9f79902d0334" released by "delete_volume" :: held 1.061s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Created reservations ['f945cb69-be99-4fe5-bf6b-2122429a4a08', '9a63b392-53e5-4871-9725-3531f022522a', '29ad5328-df72-4b9b-ac5b-6a300b501cf4', '2b1b1470-7a23-46c8-844b-86ac44ad8c3b'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:28 devstack sudo[96342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:50:28 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:28 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1 1073741824" returned: 0 in 0.547s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:28 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:50:28 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:28 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.281s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:50:28 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Deleted volume successfully. Sep 07 13:50:28 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1 Sep 07 13:50:28 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06f75d1e-bed1-4669-a4ef-6ab1dd65ce03 tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-52f732ee-e60e-49f6-a6ce-9f79902d0334-delete_volume" released by "delete_volume" :: held 3.980s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:28 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.329s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager._thread_info {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread count: 28 {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread info: [<_MainThread(MainThread, started 132147689414784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:50:28 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bo_7jxrddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-149130ce-7077-4f3a-a170-ad65573c3d67" returned: 0 in 2.339s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bo_7jxrddevstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-149130ce-7077-4f3a-a170-ad65573c3d67 {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:50:28 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Converted 112.00 MB image at 47.87 MB/s Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-149130ce-7077-4f3a-a170-ad65573c3d67 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:28 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-149130ce-7077-4f3a-a170-ad65573c3d67 1G Sep 07 13:50:28 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:28 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1" returned: 0 in 0.350s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7ad40b-03ed-4767-8707-096411e2b7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4ec2aa-136c-4edb-876c-0a4a5290ee4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:28 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Volume volume-842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1 (842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1): created successfully Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4ec2aa-136c-4edb-876c-0a4a5290ee4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Flow 'volume_create_manager' (6d4a89f3-99c6-4cf7-b274-b47435a13fc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:28 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-fe4a018d-84e8-4a8d-92dc-8ae27f326b9b tempest-VolumesListTestJSON-2073154773 None] Created volume successfully. Sep 07 13:50:29 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-149130ce-7077-4f3a-a170-ad65573c3d67 1G" returned: 0 in 0.375s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:29 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Downloaded image bdbd1541-2076-47bf-b26a-15662727e644 ((None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}])) to volume 149130ce-7077-4f3a-a170-ad65573c3d67 successfully. {{(pid=87571) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 13:50:29 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Temporary image bdbd1541-2076-47bf-b26a-15662727e644 for user a7b371bb0cf547b1ada76be1737187f3 is deleted. {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 13:50:29 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Marking volume 149130ce-7077-4f3a-a170-ad65573c3d67 as bootable. {{(pid=87571) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 13:50:29 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Copying metadata from image bdbd1541-2076-47bf-b26a-15662727e644 to 149130ce-7077-4f3a-a170-ad65573c3d67. {{(pid=87571) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 13:50:29 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Creating volume glance metadata for volume 149130ce-7077-4f3a-a170-ad65573c3d67 backed by image bdbd1541-2076-47bf-b26a-15662727e644 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87571) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 13:50:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-64921f17-df5d-4b8c-9f9b-4b08b9d2eb41 tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "cinder-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a0ab31-e0df-4428-8dd9-017b8ea3c03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-149130ce-7077-4f3a-a170-ad65573c3d67', 'volume_size': 1, 'image_id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d9d2114dd14b01a04867c896fdabaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'created_at': datetime.datetime(2026, 9, 7, 11, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdbd1541-2076-47bf-b26a-15662727e644/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec154979-e3a3-4b4b-afd9-9b79cc03c1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-64921f17-df5d-4b8c-9f9b-4b08b9d2eb41 tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:29 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Volume volume-149130ce-7077-4f3a-a170-ad65573c3d67 (149130ce-7077-4f3a-a170-ad65573c3d67): created successfully Sep 07 13:50:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec154979-e3a3-4b4b-afd9-9b79cc03c1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Flow 'volume_create_manager' (e6f23cfc-26ab-43e0-a63d-492ed253627e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-64921f17-df5d-4b8c-9f9b-4b08b9d2eb41 tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "cinder-quobyte-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:29 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-637a93b5-9ef2-4af0-8c7c-63216547dcf7 tempest-VolumesImageMetadata-440580933 None] Created volume successfully. Sep 07 13:50:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-64921f17-df5d-4b8c-9f9b-4b08b9d2eb41 tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-quobyte-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d" acquired by "delete_volume" :: waited 0.024s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:29 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad04e30b-6e92-4b25-a45d-4dd5a2af5f36]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-64921f17-df5d-4b8c-9f9b-4b08b9d2eb41 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:29 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d Sep 07 13:50:29 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:29 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-64921f17-df5d-4b8c-9f9b-4b08b9d2eb41 tempest-VolumesDeleteCascade-1249194852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d" returned: 0 in 0.371s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-64921f17-df5d-4b8c-9f9b-4b08b9d2eb41 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:29 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d Sep 07 13:50:29 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:29 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-64921f17-df5d-4b8c-9f9b-4b08b9d2eb41 tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d" returned: 0 in 0.295s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-64921f17-df5d-4b8c-9f9b-4b08b9d2eb41 tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-quobyte-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d" released by "delete_volume" :: held 0.704s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-64921f17-df5d-4b8c-9f9b-4b08b9d2eb41 tempest-VolumesDeleteCascade-1249194852 None] Created reservations ['2b086b75-936f-4b3d-8eb0-87cfe2e18aa3', 'aebf7f11-44aa-43b7-8288-97871f4f8d3d', '42a02c9b-0b51-41fa-b60d-6348392b5fcf', '481ec582-c940-4c01-b341-75522e4591a6'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-64921f17-df5d-4b8c-9f9b-4b08b9d2eb41 tempest-VolumesDeleteCascade-1249194852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-64921f17-df5d-4b8c-9f9b-4b08b9d2eb41 tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-64921f17-df5d-4b8c-9f9b-4b08b9d2eb41 tempest-VolumesDeleteCascade-1249194852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-64921f17-df5d-4b8c-9f9b-4b08b9d2eb41 tempest-VolumesDeleteCascade-1249194852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-64921f17-df5d-4b8c-9f9b-4b08b9d2eb41 tempest-VolumesDeleteCascade-1249194852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-64921f17-df5d-4b8c-9f9b-4b08b9d2eb41 tempest-VolumesDeleteCascade-1249194852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:30 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:50:30 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:30 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-64921f17-df5d-4b8c-9f9b-4b08b9d2eb41 tempest-VolumesDeleteCascade-1249194852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.367s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-64921f17-df5d-4b8c-9f9b-4b08b9d2eb41 tempest-VolumesDeleteCascade-1249194852 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:50:30 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-64921f17-df5d-4b8c-9f9b-4b08b9d2eb41 tempest-VolumesDeleteCascade-1249194852 None] Deleted volume successfully. Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-50037b1f-86b0-45bc-8ba1-5d4b79b9b7e2 tempest-VolumesImageMetadata-440580933 None] Acquiring lock "cinder-149130ce-7077-4f3a-a170-ad65573c3d67-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-64921f17-df5d-4b8c-9f9b-4b08b9d2eb41 tempest-VolumesDeleteCascade-1249194852 None] Lock "cinder-0d1b7cf7-cfb0-4228-a5da-837bc94a0a3d-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-50037b1f-86b0-45bc-8ba1-5d4b79b9b7e2 tempest-VolumesImageMetadata-440580933 None] Lock "cinder-149130ce-7077-4f3a-a170-ad65573c3d67-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Flow 'volume_create_manager' (03e24a2c-d0ce-4f7b-ade0-bd3e8bc0eef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (395dd297-ec72-4565-accf-799001499254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (395dd297-ec72-4565-accf-799001499254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1740884771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff0e75d-cea0-4607-9c08-7bf6223fe0aa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='de354f77813047bfa0e9d4f3cd6b8ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:30Z,use_quota=True,user_id='a9a7e127c1df4212b6624d449e04ef22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe60db7d-ad79-4c04-b3b2-88e9d8c6fa44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe60db7d-ad79-4c04-b3b2-88e9d8c6fa44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc73b291-2d4b-4b0b-b763-5bfd9fdf44e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc73b291-2d4b-4b0b-b763-5bfd9fdf44e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fff0e75d-cea0-4607-9c08-7bf6223fe0aa', 'volume_name': 'volume-fff0e75d-cea0-4607-9c08-7bf6223fe0aa', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69a7dc0-b835-45a1-be3f-7c6866b49ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69a7dc0-b835-45a1-be3f-7c6866b49ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830668ba-2b98-4ea0-99cc-f94ebbc758ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:30 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Volume fff0e75d-cea0-4607-9c08-7bf6223fe0aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fff0e75d-cea0-4607-9c08-7bf6223fe0aa', 'volume_size': 1} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1740884771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff0e75d-cea0-4607-9c08-7bf6223fe0aa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='de354f77813047bfa0e9d4f3cd6b8ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:30Z,use_quota=True,user_id='a9a7e127c1df4212b6624d449e04ef22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Creating volume fff0e75d-cea0-4607-9c08-7bf6223fe0aa {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:50:30 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fff0e75d-cea0-4607-9c08-7bf6223fe0aa 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:30 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fff0e75d-cea0-4607-9c08-7bf6223fe0aa 1073741824 Sep 07 13:50:30 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-50037b1f-86b0-45bc-8ba1-5d4b79b9b7e2 tempest-VolumesImageMetadata-440580933 None] Acquiring lock "cinder-quobyte-149130ce-7077-4f3a-a170-ad65573c3d67" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-50037b1f-86b0-45bc-8ba1-5d4b79b9b7e2 tempest-VolumesImageMetadata-440580933 None] Lock "cinder-quobyte-149130ce-7077-4f3a-a170-ad65573c3d67" acquired by "delete_volume" :: waited 0.028s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b7379b-5c07-44ee-893a-f6917c4d52b5]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-50037b1f-86b0-45bc-8ba1-5d4b79b9b7e2 tempest-VolumesImageMetadata-440580933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-149130ce-7077-4f3a-a170-ad65573c3d67 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:30 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-149130ce-7077-4f3a-a170-ad65573c3d67 Sep 07 13:50:30 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:31 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-50037b1f-86b0-45bc-8ba1-5d4b79b9b7e2 tempest-VolumesImageMetadata-440580933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-149130ce-7077-4f3a-a170-ad65573c3d67" returned: 0 in 0.426s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-50037b1f-86b0-45bc-8ba1-5d4b79b9b7e2 tempest-VolumesImageMetadata-440580933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-149130ce-7077-4f3a-a170-ad65573c3d67 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:31 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-149130ce-7077-4f3a-a170-ad65573c3d67 Sep 07 13:50:31 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:31 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fff0e75d-cea0-4607-9c08-7bf6223fe0aa 1073741824" returned: 0 in 0.679s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fff0e75d-cea0-4607-9c08-7bf6223fe0aa {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:31 devstack sudo[96382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fff0e75d-cea0-4607-9c08-7bf6223fe0aa Sep 07 13:50:31 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:31 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-50037b1f-86b0-45bc-8ba1-5d4b79b9b7e2 tempest-VolumesImageMetadata-440580933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-149130ce-7077-4f3a-a170-ad65573c3d67" returned: 0 in 0.318s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:31 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-50037b1f-86b0-45bc-8ba1-5d4b79b9b7e2 tempest-VolumesImageMetadata-440580933 None] Lock "cinder-quobyte-149130ce-7077-4f3a-a170-ad65573c3d67" released by "delete_volume" :: held 0.807s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:31 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-50037b1f-86b0-45bc-8ba1-5d4b79b9b7e2 tempest-VolumesImageMetadata-440580933 None] Created reservations ['e4ddaf05-d622-4cad-89e0-5f3e2e852178', 'ed2c065f-3a96-4867-a0c7-ee6567b8f5e7', '0be1cea3-bc16-4a46-a318-f558e089fd32', '4b864f80-86de-4447-ac29-3891509adf91'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-50037b1f-86b0-45bc-8ba1-5d4b79b9b7e2 tempest-VolumesImageMetadata-440580933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-50037b1f-86b0-45bc-8ba1-5d4b79b9b7e2 tempest-VolumesImageMetadata-440580933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-50037b1f-86b0-45bc-8ba1-5d4b79b9b7e2 tempest-VolumesImageMetadata-440580933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-50037b1f-86b0-45bc-8ba1-5d4b79b9b7e2 tempest-VolumesImageMetadata-440580933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-50037b1f-86b0-45bc-8ba1-5d4b79b9b7e2 tempest-VolumesImageMetadata-440580933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-50037b1f-86b0-45bc-8ba1-5d4b79b9b7e2 tempest-VolumesImageMetadata-440580933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:31 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:31 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:50:31 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fff0e75d-cea0-4607-9c08-7bf6223fe0aa" returned: 0 in 0.406s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:50:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830668ba-2b98-4ea0-99cc-f94ebbc758ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fff0e75d-cea0-4607-9c08-7bf6223fe0aa', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef095593-5e1d-42ad-92e5-797a85bebd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:31 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Volume volume-fff0e75d-cea0-4607-9c08-7bf6223fe0aa (fff0e75d-cea0-4607-9c08-7bf6223fe0aa): created successfully Sep 07 13:50:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef095593-5e1d-42ad-92e5-797a85bebd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Flow 'volume_create_manager' (03e24a2c-d0ce-4f7b-ade0-bd3e8bc0eef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:32 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-ce1b3d6e-2a0a-418a-b72d-5b3dcd9ade6f tempest-VolumesListTestJSON-2073154773 None] Created volume successfully. Sep 07 13:50:32 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-50037b1f-86b0-45bc-8ba1-5d4b79b9b7e2 tempest-VolumesImageMetadata-440580933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.417s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:32 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-50037b1f-86b0-45bc-8ba1-5d4b79b9b7e2 tempest-VolumesImageMetadata-440580933 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:50:32 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-50037b1f-86b0-45bc-8ba1-5d4b79b9b7e2 tempest-VolumesImageMetadata-440580933 None] Deleted volume successfully. Sep 07 13:50:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-50037b1f-86b0-45bc-8ba1-5d4b79b9b7e2 tempest-VolumesImageMetadata-440580933 None] Lock "cinder-149130ce-7077-4f3a-a170-ad65573c3d67-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:33 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:50:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Flow 'volume_create_manager' (f5a2ae31-65c5-4ab7-befa-c924e3d50998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46b69b4-b3a1-48cf-91db-0b6e1e2ee530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46b69b4-b3a1-48cf-91db-0b6e1e2ee530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-821316340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b53bc7-2606-44a9-86df-824e1ab069e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='de354f77813047bfa0e9d4f3cd6b8ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:33Z,use_quota=True,user_id='a9a7e127c1df4212b6624d449e04ef22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f43e64e3-c553-4adc-9958-3b11ae238695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f43e64e3-c553-4adc-9958-3b11ae238695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510ceb15-5b6f-4dd0-a84a-f71033e11d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510ceb15-5b6f-4dd0-a84a-f71033e11d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b53bc7-2606-44a9-86df-824e1ab069e0', 'volume_name': 'volume-03b53bc7-2606-44a9-86df-824e1ab069e0', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5ab970-6c92-4a43-9f91-fce4b96d59b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5ab970-6c92-4a43-9f91-fce4b96d59b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49dcf633-9390-4bdc-853d-a97bc3203236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:33 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Volume 03b53bc7-2606-44a9-86df-824e1ab069e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b53bc7-2606-44a9-86df-824e1ab069e0', 'volume_size': 1} Sep 07 13:50:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-821316340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b53bc7-2606-44a9-86df-824e1ab069e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='de354f77813047bfa0e9d4f3cd6b8ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:33Z,use_quota=True,user_id='a9a7e127c1df4212b6624d449e04ef22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:50:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Creating volume 03b53bc7-2606-44a9-86df-824e1ab069e0 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:50:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:50:33 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:50:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-03b53bc7-2606-44a9-86df-824e1ab069e0 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:33 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-03b53bc7-2606-44a9-86df-824e1ab069e0 1073741824 Sep 07 13:50:33 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:34 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-03b53bc7-2606-44a9-86df-824e1ab069e0 1073741824" returned: 0 in 0.737s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-03b53bc7-2606-44a9-86df-824e1ab069e0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:34 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-03b53bc7-2606-44a9-86df-824e1ab069e0 Sep 07 13:50:34 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:34 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-03b53bc7-2606-44a9-86df-824e1ab069e0" returned: 0 in 0.316s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:50:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49dcf633-9390-4bdc-853d-a97bc3203236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b53bc7-2606-44a9-86df-824e1ab069e0', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634d4977-0faf-4f68-bb2e-7d43d3923423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:34 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Volume volume-03b53bc7-2606-44a9-86df-824e1ab069e0 (03b53bc7-2606-44a9-86df-824e1ab069e0): created successfully Sep 07 13:50:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634d4977-0faf-4f68-bb2e-7d43d3923423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Flow 'volume_create_manager' (f5a2ae31-65c5-4ab7-befa-c924e3d50998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:34 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-502a8457-95d9-4d36-aced-0b861617dc11 tempest-VolumesListTestJSON-2073154773 None] Created volume successfully. Sep 07 13:50:36 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:50:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Flow 'volume_create_manager' (278c6408-9787-44bd-ad0d-f823b293b197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79013eef-98f3-4cbd-b415-d978689f997b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79013eef-98f3-4cbd-b415-d978689f997b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2145543053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e28988a-48fa-45c0-a980-adee14f40e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8c37129a714c7cb3dc69f309ed5d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:36Z,use_quota=True,user_id='24a37bc0d3544837ba5b0196bbcc2ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dbf8d1c-c000-411c-988d-bba2f81c9aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dbf8d1c-c000-411c-988d-bba2f81c9aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (485f4938-4722-471e-9332-b195266ed6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (485f4938-4722-471e-9332-b195266ed6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e28988a-48fa-45c0-a980-adee14f40e78', 'volume_name': 'volume-9e28988a-48fa-45c0-a980-adee14f40e78', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9378f0-6dee-4220-bf69-e5962392b779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9378f0-6dee-4220-bf69-e5962392b779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7a89af-c47f-465e-8429-c38b637fb0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:36 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Volume 9e28988a-48fa-45c0-a980-adee14f40e78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e28988a-48fa-45c0-a980-adee14f40e78', 'volume_size': 1} Sep 07 13:50:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2145543053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e28988a-48fa-45c0-a980-adee14f40e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8c37129a714c7cb3dc69f309ed5d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:36Z,use_quota=True,user_id='24a37bc0d3544837ba5b0196bbcc2ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:50:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Creating volume 9e28988a-48fa-45c0-a980-adee14f40e78 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:50:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:50:36 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:50:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:36 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78 1073741824 Sep 07 13:50:36 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:37 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78 1073741824" returned: 0 in 0.698s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:37 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78 Sep 07 13:50:37 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:37 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78" returned: 0 in 0.511s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:37 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:50:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7a89af-c47f-465e-8429-c38b637fb0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e28988a-48fa-45c0-a980-adee14f40e78', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e96f2d-6dab-49d0-95e3-46b6a6502805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:37 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Volume volume-9e28988a-48fa-45c0-a980-adee14f40e78 (9e28988a-48fa-45c0-a980-adee14f40e78): created successfully Sep 07 13:50:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e96f2d-6dab-49d0-95e3-46b6a6502805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Flow 'volume_create_manager' (278c6408-9787-44bd-ad0d-f823b293b197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:37 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-1d2c4103-7a52-4826-a335-1d5d711cc70e tempest-VolumesCloneTest-1319462455 None] Created volume successfully. Sep 07 13:50:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0d832711-075d-4b83-8204-cf5bb2d6af5b tempest-VolumesListTestJSON-2073154773 None] Acquiring lock "cinder-03b53bc7-2606-44a9-86df-824e1ab069e0-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0d832711-075d-4b83-8204-cf5bb2d6af5b tempest-VolumesListTestJSON-2073154773 None] Lock "cinder-03b53bc7-2606-44a9-86df-824e1ab069e0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0d832711-075d-4b83-8204-cf5bb2d6af5b tempest-VolumesListTestJSON-2073154773 None] Acquiring lock "cinder-quobyte-03b53bc7-2606-44a9-86df-824e1ab069e0" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0d832711-075d-4b83-8204-cf5bb2d6af5b tempest-VolumesListTestJSON-2073154773 None] Lock "cinder-quobyte-03b53bc7-2606-44a9-86df-824e1ab069e0" acquired by "delete_volume" :: waited 0.047s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:39 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ed38c1-b494-4158-855f-f191fa3869ce]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0d832711-075d-4b83-8204-cf5bb2d6af5b tempest-VolumesListTestJSON-2073154773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-03b53bc7-2606-44a9-86df-824e1ab069e0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:39 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-03b53bc7-2606-44a9-86df-824e1ab069e0 Sep 07 13:50:39 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:39 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:50:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Flow 'volume_create_manager' (1da9ad1b-6b03-4ba7-8f4b-a2155913a50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b783bee8-e8e1-4c03-9851-eae3bed72929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b783bee8-e8e1-4c03-9851-eae3bed72929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-302140779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d1b9452-00cd-4cf6-887f-af64bcf875b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8c37129a714c7cb3dc69f309ed5d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=9e28988a-48fa-45c0-a980-adee14f40e78,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:40Z,use_quota=True,user_id='24a37bc0d3544837ba5b0196bbcc2ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db4ab7b6-2ef8-4210-813e-aa8df3a6556b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db4ab7b6-2ef8-4210-813e-aa8df3a6556b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98405bfb-bda8-41dd-a8e8-83d05b4e3043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98405bfb-bda8-41dd-a8e8-83d05b4e3043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4d1b9452-00cd-4cf6-887f-af64bcf875b5', 'volume_name': 'volume-4d1b9452-00cd-4cf6-887f-af64bcf875b5', 'volume_size': 2, 'source_volid': '9e28988a-48fa-45c0-a980-adee14f40e78', 'source_volstatus': 'available'}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0730cecb-19f3-48f2-b3a3-af102ac64862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0730cecb-19f3-48f2-b3a3-af102ac64862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b7f6a5-e720-45c0-b7b4-023ffc20b5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:39 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Volume 4d1b9452-00cd-4cf6-887f-af64bcf875b5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4d1b9452-00cd-4cf6-887f-af64bcf875b5', 'volume_size': 2, 'source_volid': '9e28988a-48fa-45c0-a980-adee14f40e78', 'source_volstatus': 'available'} Sep 07 13:50:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:39 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Cloning volume 9e28988a-48fa-45c0-a980-adee14f40e78 to volume 4d1b9452-00cd-4cf6-887f-af64bcf875b5 Sep 07 13:50:40 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:40 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Creating offline snapshot 5322fd33-c5db-4a20-9e22-144f9cd0599a of volume 9e28988a-48fa-45c0-a980-adee14f40e78 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:50:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0d832711-075d-4b83-8204-cf5bb2d6af5b tempest-VolumesListTestJSON-2073154773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-03b53bc7-2606-44a9-86df-824e1ab069e0" returned: 0 in 0.621s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0d832711-075d-4b83-8204-cf5bb2d6af5b tempest-VolumesListTestJSON-2073154773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-03b53bc7-2606-44a9-86df-824e1ab069e0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:40 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[64725e56-7f63-473f-9a01-6677eeb52181]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:40 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-03b53bc7-2606-44a9-86df-824e1ab069e0 Sep 07 13:50:40 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:40 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78 Sep 07 13:50:40 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:40 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0d832711-075d-4b83-8204-cf5bb2d6af5b tempest-VolumesListTestJSON-2073154773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-03b53bc7-2606-44a9-86df-824e1ab069e0" returned: 0 in 0.432s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:40 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0d832711-075d-4b83-8204-cf5bb2d6af5b tempest-VolumesListTestJSON-2073154773 None] Lock "cinder-quobyte-03b53bc7-2606-44a9-86df-824e1ab069e0" released by "delete_volume" :: held 1.167s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:40 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-0d832711-075d-4b83-8204-cf5bb2d6af5b tempest-VolumesListTestJSON-2073154773 None] Created reservations ['19bed383-ada8-4e52-9463-16d93d46975f', '86dabb3e-6160-47ee-be91-743b65b96810', '0b23d22d-d44d-451a-a0fc-3121bea52316', '49267005-d61c-4c07-8f0b-cb192780eae4'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:40 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78" returned: 0 in 0.589s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.5322fd33-c5db-4a20-9e22-144f9cd0599a 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:40 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.5322fd33-c5db-4a20-9e22-144f9cd0599a 1G Sep 07 13:50:40 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0d832711-075d-4b83-8204-cf5bb2d6af5b tempest-VolumesListTestJSON-2073154773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0d832711-075d-4b83-8204-cf5bb2d6af5b tempest-VolumesListTestJSON-2073154773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:40 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0d832711-075d-4b83-8204-cf5bb2d6af5b tempest-VolumesListTestJSON-2073154773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:40 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0d832711-075d-4b83-8204-cf5bb2d6af5b tempest-VolumesListTestJSON-2073154773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0d832711-075d-4b83-8204-cf5bb2d6af5b tempest-VolumesListTestJSON-2073154773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0d832711-075d-4b83-8204-cf5bb2d6af5b tempest-VolumesListTestJSON-2073154773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:40 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:50:40 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:41 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0d832711-075d-4b83-8204-cf5bb2d6af5b tempest-VolumesListTestJSON-2073154773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.414s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:41 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-0d832711-075d-4b83-8204-cf5bb2d6af5b tempest-VolumesListTestJSON-2073154773 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:50:41 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-0d832711-075d-4b83-8204-cf5bb2d6af5b tempest-VolumesListTestJSON-2073154773 None] Deleted volume successfully. Sep 07 13:50:41 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0d832711-075d-4b83-8204-cf5bb2d6af5b tempest-VolumesListTestJSON-2073154773 None] Lock "cinder-03b53bc7-2606-44a9-86df-824e1ab069e0-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:41 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.5322fd33-c5db-4a20-9e22-144f9cd0599a 1G" returned: 0 in 0.704s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e28988a-48fa-45c0-a980-adee14f40e78 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.5322fd33-c5db-4a20-9e22-144f9cd0599a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:41 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e28988a-48fa-45c0-a980-adee14f40e78 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.5322fd33-c5db-4a20-9e22-144f9cd0599a Sep 07 13:50:41 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:41 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-625c738b-fb3d-4199-bec9-ad89d97a1c9e tempest-VolumesListTestJSON-2073154773 None] Acquiring lock "cinder-fff0e75d-cea0-4607-9c08-7bf6223fe0aa-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:41 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-625c738b-fb3d-4199-bec9-ad89d97a1c9e tempest-VolumesListTestJSON-2073154773 None] Lock "cinder-fff0e75d-cea0-4607-9c08-7bf6223fe0aa-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:41 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-625c738b-fb3d-4199-bec9-ad89d97a1c9e tempest-VolumesListTestJSON-2073154773 None] Acquiring lock "cinder-quobyte-fff0e75d-cea0-4607-9c08-7bf6223fe0aa" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:41 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-625c738b-fb3d-4199-bec9-ad89d97a1c9e tempest-VolumesListTestJSON-2073154773 None] Lock "cinder-quobyte-fff0e75d-cea0-4607-9c08-7bf6223fe0aa" acquired by "delete_volume" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:41 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e28988a-48fa-45c0-a980-adee14f40e78 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.5322fd33-c5db-4a20-9e22-144f9cd0599a" returned: 0 in 0.650s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:41 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.5322fd33-c5db-4a20-9e22-144f9cd0599a is being set with open permissions: ugo+rw Sep 07 13:50:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.5322fd33-c5db-4a20-9e22-144f9cd0599a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:42 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41e8d5d-f472-4014-b7c4-35dab44e9643]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-625c738b-fb3d-4199-bec9-ad89d97a1c9e tempest-VolumesListTestJSON-2073154773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fff0e75d-cea0-4607-9c08-7bf6223fe0aa {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:42 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.5322fd33-c5db-4a20-9e22-144f9cd0599a Sep 07 13:50:42 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:42 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fff0e75d-cea0-4607-9c08-7bf6223fe0aa Sep 07 13:50:42 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:42 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-625c738b-fb3d-4199-bec9-ad89d97a1c9e tempest-VolumesListTestJSON-2073154773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fff0e75d-cea0-4607-9c08-7bf6223fe0aa" returned: 0 in 0.495s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-625c738b-fb3d-4199-bec9-ad89d97a1c9e tempest-VolumesListTestJSON-2073154773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fff0e75d-cea0-4607-9c08-7bf6223fe0aa {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:42 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.5322fd33-c5db-4a20-9e22-144f9cd0599a" returned: 0 in 0.543s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:42 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fff0e75d-cea0-4607-9c08-7bf6223fe0aa Sep 07 13:50:42 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:42 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.info Sep 07 13:50:42 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:43 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-625c738b-fb3d-4199-bec9-ad89d97a1c9e tempest-VolumesListTestJSON-2073154773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fff0e75d-cea0-4607-9c08-7bf6223fe0aa" returned: 0 in 0.551s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:43 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.info" returned: 0 in 0.492s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:43 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.info is being set with open permissions: ugo+rw Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-625c738b-fb3d-4199-bec9-ad89d97a1c9e tempest-VolumesListTestJSON-2073154773 None] Lock "cinder-quobyte-fff0e75d-cea0-4607-9c08-7bf6223fe0aa" released by "delete_volume" :: held 1.154s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:43 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.info Sep 07 13:50:43 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-625c738b-fb3d-4199-bec9-ad89d97a1c9e tempest-VolumesListTestJSON-2073154773 None] Created reservations ['8d81ae7d-a7ec-47c4-8e34-1f45976e620d', '736174a1-e5eb-4cd8-8697-7f44838187a1', 'e92bedf0-34c2-475c-a224-5603aeb8020b', '6428a2bc-7814-42c9-9cf1-c94eae93a6c1'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-625c738b-fb3d-4199-bec9-ad89d97a1c9e tempest-VolumesListTestJSON-2073154773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-625c738b-fb3d-4199-bec9-ad89d97a1c9e tempest-VolumesListTestJSON-2073154773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-625c738b-fb3d-4199-bec9-ad89d97a1c9e tempest-VolumesListTestJSON-2073154773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-625c738b-fb3d-4199-bec9-ad89d97a1c9e tempest-VolumesListTestJSON-2073154773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-625c738b-fb3d-4199-bec9-ad89d97a1c9e tempest-VolumesListTestJSON-2073154773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-625c738b-fb3d-4199-bec9-ad89d97a1c9e tempest-VolumesListTestJSON-2073154773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:43 devstack sudo[96551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:50:43 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:43 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.info" returned: 0 in 0.426s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Acquiring lock "cinder-quobyte-4d1b9452-00cd-4cf6-887f-af64bcf875b5" by "_copy_volume_from_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Lock "cinder-quobyte-4d1b9452-00cd-4cf6-887f-af64bcf875b5" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] snapshot: 5322fd33-c5db-4a20-9e22-144f9cd0599a, volume: 4d1b9452-00cd-4cf6-887f-af64bcf875b5, {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cbf1eb-d0fb-42e7-aac1-6e60604e21c9]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.5322fd33-c5db-4a20-9e22-144f9cd0599a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:43 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-625c738b-fb3d-4199-bec9-ad89d97a1c9e tempest-VolumesListTestJSON-2073154773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.386s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-625c738b-fb3d-4199-bec9-ad89d97a1c9e tempest-VolumesListTestJSON-2073154773 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:50:43 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-625c738b-fb3d-4199-bec9-ad89d97a1c9e tempest-VolumesListTestJSON-2073154773 None] Deleted volume successfully. Sep 07 13:50:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-625c738b-fb3d-4199-bec9-ad89d97a1c9e tempest-VolumesListTestJSON-2073154773 None] Lock "cinder-fff0e75d-cea0-4607-9c08-7bf6223fe0aa-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:43 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.5322fd33-c5db-4a20-9e22-144f9cd0599a Sep 07 13:50:43 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:44 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.5322fd33-c5db-4a20-9e22-144f9cd0599a" returned: 0 in 0.520s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e28988a-48fa-45c0-a980-adee14f40e78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:50:44 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8286143d-d0bf-42d7-8924-c8a9473932ef]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d03bafe4-8cb2-452c-a87b-3b53ca7c2212 tempest-VolumesListTestJSON-2073154773 None] Acquiring lock "cinder-842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d03bafe4-8cb2-452c-a87b-3b53ca7c2212 tempest-VolumesListTestJSON-2073154773 None] Lock "cinder-842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:44 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78 Sep 07 13:50:44 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d03bafe4-8cb2-452c-a87b-3b53ca7c2212 tempest-VolumesListTestJSON-2073154773 None] Acquiring lock "cinder-quobyte-842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d03bafe4-8cb2-452c-a87b-3b53ca7c2212 tempest-VolumesListTestJSON-2073154773 None] Lock "cinder-quobyte-842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:44 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f8e91d-61aa-495b-9505-8a521c6f262e]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d03bafe4-8cb2-452c-a87b-3b53ca7c2212 tempest-VolumesListTestJSON-2073154773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:44 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1 Sep 07 13:50:44 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:44 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78" returned: 0 in 0.604s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78 {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 13:50:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Creating direct copy from snapshot {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 13:50:44 devstack cinder-volume[87571]: DEBUG cinder.utils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Path /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4d1b9452-00cd-4cf6-887f-af64bcf875b5 not found in is_blk_device check {{(pid=87571) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 13:50:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4d1b9452-00cd-4cf6-887f-af64bcf875b5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:44 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4d1b9452-00cd-4cf6-887f-af64bcf875b5 Sep 07 13:50:44 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:44 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d03bafe4-8cb2-452c-a87b-3b53ca7c2212 tempest-VolumesListTestJSON-2073154773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1" returned: 0 in 0.465s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d03bafe4-8cb2-452c-a87b-3b53ca7c2212 tempest-VolumesListTestJSON-2073154773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:45 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1 Sep 07 13:50:45 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:45 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d03bafe4-8cb2-452c-a87b-3b53ca7c2212 tempest-VolumesListTestJSON-2073154773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1" returned: 0 in 0.308s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:45 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d03bafe4-8cb2-452c-a87b-3b53ca7c2212 tempest-VolumesListTestJSON-2073154773 None] Lock "cinder-quobyte-842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1" released by "delete_volume" :: held 0.820s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:45 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-d03bafe4-8cb2-452c-a87b-3b53ca7c2212 tempest-VolumesListTestJSON-2073154773 None] Created reservations ['ddd376af-fd7b-45be-966d-1dd913386afa', '6b9f3f3d-50aa-43b4-88a5-4bd1808f5004', 'cd2be61d-acfc-4e6f-bfb3-0a59d5a386be', '4ae06008-e89a-4e29-82ed-15ac4f26eca7'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d03bafe4-8cb2-452c-a87b-3b53ca7c2212 tempest-VolumesListTestJSON-2073154773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d03bafe4-8cb2-452c-a87b-3b53ca7c2212 tempest-VolumesListTestJSON-2073154773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:45 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d03bafe4-8cb2-452c-a87b-3b53ca7c2212 tempest-VolumesListTestJSON-2073154773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:45 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d03bafe4-8cb2-452c-a87b-3b53ca7c2212 tempest-VolumesListTestJSON-2073154773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d03bafe4-8cb2-452c-a87b-3b53ca7c2212 tempest-VolumesListTestJSON-2073154773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d03bafe4-8cb2-452c-a87b-3b53ca7c2212 tempest-VolumesListTestJSON-2073154773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:45 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:50:45 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:46 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d03bafe4-8cb2-452c-a87b-3b53ca7c2212 tempest-VolumesListTestJSON-2073154773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 1.064s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:46 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-d03bafe4-8cb2-452c-a87b-3b53ca7c2212 tempest-VolumesListTestJSON-2073154773 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:50:46 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-d03bafe4-8cb2-452c-a87b-3b53ca7c2212 tempest-VolumesListTestJSON-2073154773 None] Deleted volume successfully. Sep 07 13:50:46 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d03bafe4-8cb2-452c-a87b-3b53ca7c2212 tempest-VolumesListTestJSON-2073154773 None] Lock "cinder-842a72d9-84ff-4fd2-9ee4-8ef047b6d3a1-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:46 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:50:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Flow 'volume_create_manager' (12f63a57-914e-4f31-84ae-3e1baa15cbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1807d6ad-4158-47c0-8bc6-08e436dfd62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1807d6ad-4158-47c0-8bc6-08e436dfd62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1745528786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4002a001-c995-4c73-84c7-36f7b192030d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e7d7bca2404716b0135867c68c1d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:47Z,use_quota=True,user_id='b6517a84136f47ae8adcd64004a65abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1aa5bd9-ab96-4347-a6b9-99ac6f2412ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1aa5bd9-ab96-4347-a6b9-99ac6f2412ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a882dd-2ebd-4b68-9e60-387e7f239463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a882dd-2ebd-4b68-9e60-387e7f239463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4002a001-c995-4c73-84c7-36f7b192030d', 'volume_name': 'volume-4002a001-c995-4c73-84c7-36f7b192030d', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7fe3ec7-98d1-44ac-a654-e1b31c6e6def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7fe3ec7-98d1-44ac-a654-e1b31c6e6def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (439d7b77-62a3-4e6e-bfc8-ff9e801f39a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:47 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Volume 4002a001-c995-4c73-84c7-36f7b192030d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4002a001-c995-4c73-84c7-36f7b192030d', 'volume_size': 1} Sep 07 13:50:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:51 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4d1b9452-00cd-4cf6-887f-af64bcf875b5" returned: 0 in 6.468s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:51 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78, size 1024.00 MB, duration 6.47 sec, destination /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4d1b9452-00cd-4cf6-887f-af64bcf875b5 {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:50:51 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Converted 1024.00 MB image at 158.29 MB/s Sep 07 13:50:51 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4d1b9452-00cd-4cf6-887f-af64bcf875b5 is being set with open permissions: ugo+rw Sep 07 13:50:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4d1b9452-00cd-4cf6-887f-af64bcf875b5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:51 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4d1b9452-00cd-4cf6-887f-af64bcf875b5 Sep 07 13:50:51 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:51 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4d1b9452-00cd-4cf6-887f-af64bcf875b5" returned: 0 in 0.266s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Lock "cinder-quobyte-4d1b9452-00cd-4cf6-887f-af64bcf875b5" released by "_copy_volume_from_snapshot" :: held 7.983s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Acquiring lock "cinder-quobyte-5322fd33-c5db-4a20-9e22-144f9cd0599a" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Lock "cinder-quobyte-5322fd33-c5db-4a20-9e22-144f9cd0599a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Deleting offline snapshot 5322fd33-c5db-4a20-9e22-144f9cd0599a of volume 9e28988a-48fa-45c0-a980-adee14f40e78 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:50:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] snapshot_file for this snap is: volume-9e28988a-48fa-45c0-a980-adee14f40e78.5322fd33-c5db-4a20-9e22-144f9cd0599a {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:50:51 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7283699e-4cb6-42a3-a5e7-6eeaab916f04]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.5322fd33-c5db-4a20-9e22-144f9cd0599a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:51 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.5322fd33-c5db-4a20-9e22-144f9cd0599a Sep 07 13:50:51 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:52 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.5322fd33-c5db-4a20-9e22-144f9cd0599a" returned: 0 in 0.396s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:52 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e28988a-48fa-45c0-a980-adee14f40e78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:50:52 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cd6481-ff6c-4920-bbe9-d582c2d93fe0]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:52 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78 Sep 07 13:50:52 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:52 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78" returned: 0 in 0.582s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.5322fd33-c5db-4a20-9e22-144f9cd0599a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:52 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.5322fd33-c5db-4a20-9e22-144f9cd0599a Sep 07 13:50:52 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:52 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.5322fd33-c5db-4a20-9e22-144f9cd0599a" returned: 0 in 0.367s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.5322fd33-c5db-4a20-9e22-144f9cd0599a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:53 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.5322fd33-c5db-4a20-9e22-144f9cd0599a Sep 07 13:50:53 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:53 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78.5322fd33-c5db-4a20-9e22-144f9cd0599a" returned: 0 in 0.283s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:53 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Lock "cinder-quobyte-5322fd33-c5db-4a20-9e22-144f9cd0599a" released by "_delete_snapshot" :: held 1.739s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.414s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.095s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1745528786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4002a001-c995-4c73-84c7-36f7b192030d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e7d7bca2404716b0135867c68c1d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:47Z,use_quota=True,user_id='b6517a84136f47ae8adcd64004a65abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:50:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Creating volume 4002a001-c995-4c73-84c7-36f7b192030d {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:50:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:50:53 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:50:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4002a001-c995-4c73-84c7-36f7b192030d 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b7f6a5-e720-45c0-b7b4-023ffc20b5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d1b9452-00cd-4cf6-887f-af64bcf875b5', 'volume_size': 2, 'source_volid': '9e28988a-48fa-45c0-a980-adee14f40e78', 'source_volstatus': 'available'}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:53 devstack sudo[96637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4002a001-c995-4c73-84c7-36f7b192030d 1073741824 Sep 07 13:50:53 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb232b60-2706-48ac-b020-01503ab94fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:53 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Volume volume-4d1b9452-00cd-4cf6-887f-af64bcf875b5 (4d1b9452-00cd-4cf6-887f-af64bcf875b5): created successfully Sep 07 13:50:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb232b60-2706-48ac-b020-01503ab94fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Flow 'volume_create_manager' (1da9ad1b-6b03-4ba7-8f4b-a2155913a50e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:53 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c93cb143-d26c-4ded-8d35-0bf812924810 tempest-VolumesCloneTest-1319462455 None] Created volume successfully. Sep 07 13:50:53 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4002a001-c995-4c73-84c7-36f7b192030d 1073741824" returned: 0 in 0.539s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4002a001-c995-4c73-84c7-36f7b192030d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:53 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4002a001-c995-4c73-84c7-36f7b192030d Sep 07 13:50:53 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:54 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4002a001-c995-4c73-84c7-36f7b192030d" returned: 0 in 0.249s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:54 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:50:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (439d7b77-62a3-4e6e-bfc8-ff9e801f39a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4002a001-c995-4c73-84c7-36f7b192030d', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89318c26-ac9b-4728-91e2-ec90c923b450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:54 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Volume volume-4002a001-c995-4c73-84c7-36f7b192030d (4002a001-c995-4c73-84c7-36f7b192030d): created successfully Sep 07 13:50:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89318c26-ac9b-4728-91e2-ec90c923b450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Flow 'volume_create_manager' (12f63a57-914e-4f31-84ae-3e1baa15cbe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:54 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-f4feefd8-62a4-4a96-95e8-9228e0e31434 tempest-VolumesTransfersV357Test-397833927 None] Created volume successfully. Sep 07 13:50:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4abafe95-6a31-4e96-88cc-e8c4ebea8aa9 tempest-VolumesCloneTest-1319462455 None] Acquiring lock "cinder-4d1b9452-00cd-4cf6-887f-af64bcf875b5-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4abafe95-6a31-4e96-88cc-e8c4ebea8aa9 tempest-VolumesCloneTest-1319462455 None] Lock "cinder-4d1b9452-00cd-4cf6-887f-af64bcf875b5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4abafe95-6a31-4e96-88cc-e8c4ebea8aa9 tempest-VolumesCloneTest-1319462455 None] Acquiring lock "cinder-quobyte-4d1b9452-00cd-4cf6-887f-af64bcf875b5" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4abafe95-6a31-4e96-88cc-e8c4ebea8aa9 tempest-VolumesCloneTest-1319462455 None] Lock "cinder-quobyte-4d1b9452-00cd-4cf6-887f-af64bcf875b5" acquired by "delete_volume" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:55 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3256d973-09a7-4327-81f0-90806aded0ce]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4abafe95-6a31-4e96-88cc-e8c4ebea8aa9 tempest-VolumesCloneTest-1319462455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4d1b9452-00cd-4cf6-887f-af64bcf875b5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:55 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4d1b9452-00cd-4cf6-887f-af64bcf875b5 Sep 07 13:50:55 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:55 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-a9c65041-3426-4d17-9077-646e61ae4270 tempest-VolumesTransfersV357Test-1673767618 None] Transfer volume completed successfully. Sep 07 13:50:55 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4abafe95-6a31-4e96-88cc-e8c4ebea8aa9 tempest-VolumesCloneTest-1319462455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4d1b9452-00cd-4cf6-887f-af64bcf875b5" returned: 0 in 0.451s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4abafe95-6a31-4e96-88cc-e8c4ebea8aa9 tempest-VolumesCloneTest-1319462455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4d1b9452-00cd-4cf6-887f-af64bcf875b5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:55 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4d1b9452-00cd-4cf6-887f-af64bcf875b5 Sep 07 13:50:55 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:55 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4abafe95-6a31-4e96-88cc-e8c4ebea8aa9 tempest-VolumesCloneTest-1319462455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4d1b9452-00cd-4cf6-887f-af64bcf875b5" returned: 0 in 0.310s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4abafe95-6a31-4e96-88cc-e8c4ebea8aa9 tempest-VolumesCloneTest-1319462455 None] Lock "cinder-quobyte-4d1b9452-00cd-4cf6-887f-af64bcf875b5" released by "delete_volume" :: held 0.812s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:55 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-4abafe95-6a31-4e96-88cc-e8c4ebea8aa9 tempest-VolumesCloneTest-1319462455 None] Created reservations ['136c68b8-a760-4aff-8ce3-c7b7ec456171', '6ab8531d-b4bc-4a9b-bc0f-01c1a3cd93ab', 'a9638d00-3f88-4dee-849f-cd3ef2fb4397', '8429c7db-34ba-4181-9edb-96fd7ec138af'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4abafe95-6a31-4e96-88cc-e8c4ebea8aa9 tempest-VolumesCloneTest-1319462455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4abafe95-6a31-4e96-88cc-e8c4ebea8aa9 tempest-VolumesCloneTest-1319462455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4abafe95-6a31-4e96-88cc-e8c4ebea8aa9 tempest-VolumesCloneTest-1319462455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4abafe95-6a31-4e96-88cc-e8c4ebea8aa9 tempest-VolumesCloneTest-1319462455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4abafe95-6a31-4e96-88cc-e8c4ebea8aa9 tempest-VolumesCloneTest-1319462455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4abafe95-6a31-4e96-88cc-e8c4ebea8aa9 tempest-VolumesCloneTest-1319462455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:56 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:50:56 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0b8622f6-b62e-491f-9cf6-1efa44bb636e tempest-VolumesTransfersV357Test-1821354055 None] Acquiring lock "cinder-4002a001-c995-4c73-84c7-36f7b192030d-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0b8622f6-b62e-491f-9cf6-1efa44bb636e tempest-VolumesTransfersV357Test-1821354055 None] Lock "cinder-4002a001-c995-4c73-84c7-36f7b192030d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0b8622f6-b62e-491f-9cf6-1efa44bb636e tempest-VolumesTransfersV357Test-1821354055 None] Acquiring lock "cinder-quobyte-4002a001-c995-4c73-84c7-36f7b192030d" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0b8622f6-b62e-491f-9cf6-1efa44bb636e tempest-VolumesTransfersV357Test-1821354055 None] Lock "cinder-quobyte-4002a001-c995-4c73-84c7-36f7b192030d" acquired by "delete_volume" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:56 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[988299c9-6b9a-4392-a8c6-dee454acbee9]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0b8622f6-b62e-491f-9cf6-1efa44bb636e tempest-VolumesTransfersV357Test-1821354055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4002a001-c995-4c73-84c7-36f7b192030d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:56 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4abafe95-6a31-4e96-88cc-e8c4ebea8aa9 tempest-VolumesCloneTest-1319462455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.319s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:56 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-4abafe95-6a31-4e96-88cc-e8c4ebea8aa9 tempest-VolumesCloneTest-1319462455 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:50:56 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-4abafe95-6a31-4e96-88cc-e8c4ebea8aa9 tempest-VolumesCloneTest-1319462455 None] Deleted volume successfully. Sep 07 13:50:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4abafe95-6a31-4e96-88cc-e8c4ebea8aa9 tempest-VolumesCloneTest-1319462455 None] Lock "cinder-4d1b9452-00cd-4cf6-887f-af64bcf875b5-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:56 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4002a001-c995-4c73-84c7-36f7b192030d Sep 07 13:50:56 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cb282591-dfcd-4077-ade3-f7e9c12a4a99 tempest-VolumesCloneTest-1319462455 None] Acquiring lock "cinder-9e28988a-48fa-45c0-a980-adee14f40e78-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cb282591-dfcd-4077-ade3-f7e9c12a4a99 tempest-VolumesCloneTest-1319462455 None] Lock "cinder-9e28988a-48fa-45c0-a980-adee14f40e78-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cb282591-dfcd-4077-ade3-f7e9c12a4a99 tempest-VolumesCloneTest-1319462455 None] Acquiring lock "cinder-quobyte-9e28988a-48fa-45c0-a980-adee14f40e78" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cb282591-dfcd-4077-ade3-f7e9c12a4a99 tempest-VolumesCloneTest-1319462455 None] Lock "cinder-quobyte-9e28988a-48fa-45c0-a980-adee14f40e78" acquired by "delete_volume" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:56 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9056d5c-b9f6-40da-a713-bbc4afd6c366]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cb282591-dfcd-4077-ade3-f7e9c12a4a99 tempest-VolumesCloneTest-1319462455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:56 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78 Sep 07 13:50:56 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:56 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0b8622f6-b62e-491f-9cf6-1efa44bb636e tempest-VolumesTransfersV357Test-1821354055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4002a001-c995-4c73-84c7-36f7b192030d" returned: 0 in 0.470s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0b8622f6-b62e-491f-9cf6-1efa44bb636e tempest-VolumesTransfersV357Test-1821354055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4002a001-c995-4c73-84c7-36f7b192030d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:56 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4002a001-c995-4c73-84c7-36f7b192030d Sep 07 13:50:56 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:57 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:57 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0b8622f6-b62e-491f-9cf6-1efa44bb636e tempest-VolumesTransfersV357Test-1821354055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4002a001-c995-4c73-84c7-36f7b192030d" returned: 0 in 0.274s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cb282591-dfcd-4077-ade3-f7e9c12a4a99 tempest-VolumesCloneTest-1319462455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78" returned: 0 in 0.445s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cb282591-dfcd-4077-ade3-f7e9c12a4a99 tempest-VolumesCloneTest-1319462455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0b8622f6-b62e-491f-9cf6-1efa44bb636e tempest-VolumesTransfersV357Test-1821354055 None] Lock "cinder-quobyte-4002a001-c995-4c73-84c7-36f7b192030d" released by "delete_volume" :: held 0.812s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:57 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78 Sep 07 13:50:57 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:57 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-0b8622f6-b62e-491f-9cf6-1efa44bb636e tempest-VolumesTransfersV357Test-1821354055 None] Created reservations ['10b76683-0c65-46a8-a4ef-30a433f07155', 'bc3d8ed8-88e4-46e3-8516-f923275e007d', '63cd577a-3386-4640-8010-bb8e6a7cc82b', 'fb0e3684-e69c-44b5-8b07-bd6383b62151'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0b8622f6-b62e-491f-9cf6-1efa44bb636e tempest-VolumesTransfersV357Test-1821354055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0b8622f6-b62e-491f-9cf6-1efa44bb636e tempest-VolumesTransfersV357Test-1821354055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0b8622f6-b62e-491f-9cf6-1efa44bb636e tempest-VolumesTransfersV357Test-1821354055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0b8622f6-b62e-491f-9cf6-1efa44bb636e tempest-VolumesTransfersV357Test-1821354055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0b8622f6-b62e-491f-9cf6-1efa44bb636e tempest-VolumesTransfersV357Test-1821354055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0b8622f6-b62e-491f-9cf6-1efa44bb636e tempest-VolumesTransfersV357Test-1821354055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:57 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:50:57 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:57 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cb282591-dfcd-4077-ade3-f7e9c12a4a99 tempest-VolumesCloneTest-1319462455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9e28988a-48fa-45c0-a980-adee14f40e78" returned: 0 in 0.282s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cb282591-dfcd-4077-ade3-f7e9c12a4a99 tempest-VolumesCloneTest-1319462455 None] Lock "cinder-quobyte-9e28988a-48fa-45c0-a980-adee14f40e78" released by "delete_volume" :: held 0.803s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:57 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-cb282591-dfcd-4077-ade3-f7e9c12a4a99 tempest-VolumesCloneTest-1319462455 None] Created reservations ['359ea553-d0e8-48e3-a54b-af0be2ad22bb', '67ab4b1d-a3a6-4511-94b6-ef71036a3560', 'b174bab4-2fae-4dd3-b336-a572c3e686ea', 'f1d3b7b1-65d8-4f4e-a1b4-0b92d7d4266e'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-cb282591-dfcd-4077-ade3-f7e9c12a4a99 tempest-VolumesCloneTest-1319462455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-cb282591-dfcd-4077-ade3-f7e9c12a4a99 tempest-VolumesCloneTest-1319462455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-cb282591-dfcd-4077-ade3-f7e9c12a4a99 tempest-VolumesCloneTest-1319462455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-cb282591-dfcd-4077-ade3-f7e9c12a4a99 tempest-VolumesCloneTest-1319462455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-cb282591-dfcd-4077-ade3-f7e9c12a4a99 tempest-VolumesCloneTest-1319462455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cb282591-dfcd-4077-ade3-f7e9c12a4a99 tempest-VolumesCloneTest-1319462455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:57 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0b8622f6-b62e-491f-9cf6-1efa44bb636e tempest-VolumesTransfersV357Test-1821354055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.325s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:57 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-0b8622f6-b62e-491f-9cf6-1efa44bb636e tempest-VolumesTransfersV357Test-1821354055 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:50:57 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-0b8622f6-b62e-491f-9cf6-1efa44bb636e tempest-VolumesTransfersV357Test-1821354055 None] Deleted volume successfully. Sep 07 13:50:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0b8622f6-b62e-491f-9cf6-1efa44bb636e tempest-VolumesTransfersV357Test-1821354055 None] Lock "cinder-4002a001-c995-4c73-84c7-36f7b192030d-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:57 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:50:57 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Flow 'volume_create_manager' (81646268-bce1-43fe-b38c-29bb86fd3f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca556d64-75dc-4a6f-b870-1c66add9b38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:58 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cb282591-dfcd-4077-ade3-f7e9c12a4a99 tempest-VolumesCloneTest-1319462455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.599s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-cb282591-dfcd-4077-ade3-f7e9c12a4a99 tempest-VolumesCloneTest-1319462455 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:50:58 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-cb282591-dfcd-4077-ade3-f7e9c12a4a99 tempest-VolumesCloneTest-1319462455 None] Deleted volume successfully. Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca556d64-75dc-4a6f-b870-1c66add9b38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-716410309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f6c3bf-a524-4017-905b-114114413a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e7d7bca2404716b0135867c68c1d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:58Z,use_quota=True,user_id='b6517a84136f47ae8adcd64004a65abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bffb772-3f92-4865-b024-96eab048037d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bffb772-3f92-4865-b024-96eab048037d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c38d934-0c2c-4a03-8685-703023552ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c38d934-0c2c-4a03-8685-703023552ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9f6c3bf-a524-4017-905b-114114413a2f', 'volume_name': 'volume-a9f6c3bf-a524-4017-905b-114114413a2f', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2d00bb-0167-4d57-b49d-97595e82262c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2d00bb-0167-4d57-b49d-97595e82262c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8c18d6-f8d8-45e1-8cdb-6e6be59da2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:58 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Volume a9f6c3bf-a524-4017-905b-114114413a2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9f6c3bf-a524-4017-905b-114114413a2f', 'volume_size': 1} Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-716410309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f6c3bf-a524-4017-905b-114114413a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e7d7bca2404716b0135867c68c1d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:58Z,use_quota=True,user_id='b6517a84136f47ae8adcd64004a65abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Creating volume a9f6c3bf-a524-4017-905b-114114413a2f {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:50:58 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a9f6c3bf-a524-4017-905b-114114413a2f 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cb282591-dfcd-4077-ade3-f7e9c12a4a99 tempest-VolumesCloneTest-1319462455 None] Lock "cinder-9e28988a-48fa-45c0-a980-adee14f40e78-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:58 devstack sudo[96681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a9f6c3bf-a524-4017-905b-114114413a2f 1073741824 Sep 07 13:50:58 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:58 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a9f6c3bf-a524-4017-905b-114114413a2f 1073741824" returned: 0 in 0.556s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a9f6c3bf-a524-4017-905b-114114413a2f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:58 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a9f6c3bf-a524-4017-905b-114114413a2f Sep 07 13:50:58 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:59 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a9f6c3bf-a524-4017-905b-114114413a2f" returned: 0 in 0.328s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:59 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:50:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:59 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8c18d6-f8d8-45e1-8cdb-6e6be59da2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9f6c3bf-a524-4017-905b-114114413a2f', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:59 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16229128-c4f6-4e20-b8e6-beb4d0092921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:59 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Volume volume-a9f6c3bf-a524-4017-905b-114114413a2f (a9f6c3bf-a524-4017-905b-114114413a2f): created successfully Sep 07 13:50:59 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16229128-c4f6-4e20-b8e6-beb4d0092921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:59 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Flow 'volume_create_manager' (81646268-bce1-43fe-b38c-29bb86fd3f3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:59 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-a18bd68f-d2f6-4aa5-8046-f6f08f67a32a tempest-VolumesTransfersV357Test-397833927 None] Created volume successfully. Sep 07 13:51:00 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1f7e189d-50ef-406d-b40e-bc8080f3e69a tempest-VolumesTransfersV357Test-1821354055 None] Acquiring lock "cinder-a9f6c3bf-a524-4017-905b-114114413a2f-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:00 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1f7e189d-50ef-406d-b40e-bc8080f3e69a tempest-VolumesTransfersV357Test-1821354055 None] Lock "cinder-a9f6c3bf-a524-4017-905b-114114413a2f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:00 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1f7e189d-50ef-406d-b40e-bc8080f3e69a tempest-VolumesTransfersV357Test-1821354055 None] Acquiring lock "cinder-quobyte-a9f6c3bf-a524-4017-905b-114114413a2f" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:00 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1f7e189d-50ef-406d-b40e-bc8080f3e69a tempest-VolumesTransfersV357Test-1821354055 None] Lock "cinder-quobyte-a9f6c3bf-a524-4017-905b-114114413a2f" acquired by "delete_volume" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:00 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a6f0e6-8a4a-456e-a1ed-82d55369dd12]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1f7e189d-50ef-406d-b40e-bc8080f3e69a tempest-VolumesTransfersV357Test-1821354055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a9f6c3bf-a524-4017-905b-114114413a2f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:01 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a9f6c3bf-a524-4017-905b-114114413a2f Sep 07 13:51:01 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:01 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1f7e189d-50ef-406d-b40e-bc8080f3e69a tempest-VolumesTransfersV357Test-1821354055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a9f6c3bf-a524-4017-905b-114114413a2f" returned: 0 in 0.521s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1f7e189d-50ef-406d-b40e-bc8080f3e69a tempest-VolumesTransfersV357Test-1821354055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a9f6c3bf-a524-4017-905b-114114413a2f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:01 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a9f6c3bf-a524-4017-905b-114114413a2f Sep 07 13:51:01 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:01 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1f7e189d-50ef-406d-b40e-bc8080f3e69a tempest-VolumesTransfersV357Test-1821354055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a9f6c3bf-a524-4017-905b-114114413a2f" returned: 0 in 0.340s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:01 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1f7e189d-50ef-406d-b40e-bc8080f3e69a tempest-VolumesTransfersV357Test-1821354055 None] Lock "cinder-quobyte-a9f6c3bf-a524-4017-905b-114114413a2f" released by "delete_volume" :: held 0.958s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:01 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-1f7e189d-50ef-406d-b40e-bc8080f3e69a tempest-VolumesTransfersV357Test-1821354055 None] Created reservations ['e930e631-169f-47a7-9125-908193678b55', 'c136edb8-0e26-4e73-b7fb-78ceb5bbaa61', '778d3f61-f606-4a6d-ab07-259fe81d72e7', 'a6ca9431-e816-40e5-851e-8177f3eb4e23'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:51:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1f7e189d-50ef-406d-b40e-bc8080f3e69a tempest-VolumesTransfersV357Test-1821354055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1f7e189d-50ef-406d-b40e-bc8080f3e69a tempest-VolumesTransfersV357Test-1821354055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1f7e189d-50ef-406d-b40e-bc8080f3e69a tempest-VolumesTransfersV357Test-1821354055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1f7e189d-50ef-406d-b40e-bc8080f3e69a tempest-VolumesTransfersV357Test-1821354055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1f7e189d-50ef-406d-b40e-bc8080f3e69a tempest-VolumesTransfersV357Test-1821354055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1f7e189d-50ef-406d-b40e-bc8080f3e69a tempest-VolumesTransfersV357Test-1821354055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:02 devstack sudo[96698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:51:02 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:02 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1f7e189d-50ef-406d-b40e-bc8080f3e69a tempest-VolumesTransfersV357Test-1821354055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.490s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:02 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-1f7e189d-50ef-406d-b40e-bc8080f3e69a tempest-VolumesTransfersV357Test-1821354055 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:51:02 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-1f7e189d-50ef-406d-b40e-bc8080f3e69a tempest-VolumesTransfersV357Test-1821354055 None] Deleted volume successfully. Sep 07 13:51:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1f7e189d-50ef-406d-b40e-bc8080f3e69a tempest-VolumesTransfersV357Test-1821354055 None] Lock "cinder-a9f6c3bf-a524-4017-905b-114114413a2f-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:03 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:51:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Flow 'volume_create_manager' (504609eb-baba-43a4-936d-3b33720d9da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f38690e-b9da-41ef-a3b5-82ac135fd260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f38690e-b9da-41ef-a3b5-82ac135fd260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-964699008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc362e1-bb32-470a-82f0-2c7162a0a4c9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ad578935552d4d118f97a8607eba93f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:03Z,use_quota=True,user_id='5e4cd642ccf14bc3b0fdf3ad26e0e592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aad7233-bdb3-47be-b071-b6b5e8aa4193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aad7233-bdb3-47be-b071-b6b5e8aa4193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44119a28-3ada-436b-a100-fdfb5de44a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44119a28-3ada-436b-a100-fdfb5de44a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bc362e1-bb32-470a-82f0-2c7162a0a4c9', 'volume_name': 'volume-5bc362e1-bb32-470a-82f0-2c7162a0a4c9', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca46bca3-7d07-4373-9678-afaab2797942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca46bca3-7d07-4373-9678-afaab2797942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67daa280-d5a6-4d58-9867-ae6a27685e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:03 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Volume 5bc362e1-bb32-470a-82f0-2c7162a0a4c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bc362e1-bb32-470a-82f0-2c7162a0a4c9', 'volume_size': 1} Sep 07 13:51:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:03 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-964699008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc362e1-bb32-470a-82f0-2c7162a0a4c9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ad578935552d4d118f97a8607eba93f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:03Z,use_quota=True,user_id='5e4cd642ccf14bc3b0fdf3ad26e0e592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:51:03 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Creating volume 5bc362e1-bb32-470a-82f0-2c7162a0a4c9 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:51:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:03 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:03 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:03 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:51:03 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:51:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bc362e1-bb32-470a-82f0-2c7162a0a4c9 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:03 devstack sudo[96703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bc362e1-bb32-470a-82f0-2c7162a0a4c9 1073741824 Sep 07 13:51:03 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:03 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bc362e1-bb32-470a-82f0-2c7162a0a4c9 1073741824" returned: 0 in 0.675s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bc362e1-bb32-470a-82f0-2c7162a0a4c9 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:04 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bc362e1-bb32-470a-82f0-2c7162a0a4c9 Sep 07 13:51:04 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Flow 'volume_create_manager' (6fdc9ba6-1f93-4b7b-9072-9b23a2c383ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0878c7c1-3350-481a-a514-b77a50ea0ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0878c7c1-3350-481a-a514-b77a50ea0ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-786949837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb9f44f-7a27-4dde-9d8a-500f237b492c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264acbf244d74e82a2e03338018b0238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:04Z,use_quota=True,user_id='7f3a77c8b9dc4998b0729566abf86f78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc08798-1055-4efe-9095-c02d8e66a2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc08798-1055-4efe-9095-c02d8e66a2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:04 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6651399-b9cb-48f4-a0eb-e47b1467655f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6651399-b9cb-48f4-a0eb-e47b1467655f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecb9f44f-7a27-4dde-9d8a-500f237b492c', 'volume_name': 'volume-ecb9f44f-7a27-4dde-9d8a-500f237b492c', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c04662-bda4-4578-91a6-4fc020b84172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c04662-bda4-4578-91a6-4fc020b84172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab388951-bfa0-4d8c-87ae-97778ba6092f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:04 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Volume ecb9f44f-7a27-4dde-9d8a-500f237b492c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecb9f44f-7a27-4dde-9d8a-500f237b492c', 'volume_size': 1} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bc362e1-bb32-470a-82f0-2c7162a0a4c9" returned: 0 in 0.440s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-786949837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb9f44f-7a27-4dde-9d8a-500f237b492c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264acbf244d74e82a2e03338018b0238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:04Z,use_quota=True,user_id='7f3a77c8b9dc4998b0729566abf86f78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Creating volume ecb9f44f-7a27-4dde-9d8a-500f237b492c {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:51:04 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ecb9f44f-7a27-4dde-9d8a-500f237b492c 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:04 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ecb9f44f-7a27-4dde-9d8a-500f237b492c 1073741824 Sep 07 13:51:04 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67daa280-d5a6-4d58-9867-ae6a27685e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bc362e1-bb32-470a-82f0-2c7162a0a4c9', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2993c9a3-6f6d-4634-9419-6cca549f7723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:04 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Volume volume-5bc362e1-bb32-470a-82f0-2c7162a0a4c9 (5bc362e1-bb32-470a-82f0-2c7162a0a4c9): created successfully Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2993c9a3-6f6d-4634-9419-6cca549f7723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Flow 'volume_create_manager' (504609eb-baba-43a4-936d-3b33720d9da1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:04 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-a896d3ac-a500-499f-8005-fab7702b2195 tempest-VolumesGetTest-1424992239 None] Created volume successfully. Sep 07 13:51:05 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ecb9f44f-7a27-4dde-9d8a-500f237b492c 1073741824" returned: 0 in 0.655s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ecb9f44f-7a27-4dde-9d8a-500f237b492c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:05 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ecb9f44f-7a27-4dde-9d8a-500f237b492c Sep 07 13:51:05 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:05 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ecb9f44f-7a27-4dde-9d8a-500f237b492c" returned: 0 in 0.338s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:51:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab388951-bfa0-4d8c-87ae-97778ba6092f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecb9f44f-7a27-4dde-9d8a-500f237b492c', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec616d11-4928-48e0-a2a8-6f5afd4ff21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:05 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Volume volume-ecb9f44f-7a27-4dde-9d8a-500f237b492c (ecb9f44f-7a27-4dde-9d8a-500f237b492c): created successfully Sep 07 13:51:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec616d11-4928-48e0-a2a8-6f5afd4ff21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Flow 'volume_create_manager' (6fdc9ba6-1f93-4b7b-9072-9b23a2c383ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:05 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-3a40e0e4-0a4a-4070-9520-dc5c3bbc1acc tempest-AttachVolumeShelveTestJSON-925670451 None] Created volume successfully. Sep 07 13:51:06 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:51:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Flow 'volume_create_manager' (fe590403-ea2c-4b23-84a0-9a00b92961a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b464cce3-d1dd-4b3e-a3e3-db87a515edea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b464cce3-d1dd-4b3e-a3e3-db87a515edea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1023907703',display_name='tempest-VolumesGetTest-Volume-1132672844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00c8458-9e86-4d95-aa03-d423c58ae331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad578935552d4d118f97a8607eba93f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:06Z,use_quota=True,user_id='5e4cd642ccf14bc3b0fdf3ad26e0e592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302a8ce2-ca55-4e2a-b8ce-8e00ed9e155c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302a8ce2-ca55-4e2a-b8ce-8e00ed9e155c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231bfdbe-0359-421f-8b52-92b4bd42d77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231bfdbe-0359-421f-8b52-92b4bd42d77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c00c8458-9e86-4d95-aa03-d423c58ae331', 'volume_name': 'volume-c00c8458-9e86-4d95-aa03-d423c58ae331', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aebf663-9950-4158-8f09-07bc2c1b3f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aebf663-9950-4158-8f09-07bc2c1b3f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360cdd11-ed41-4c6b-96ab-4848a4dd978f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:06 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Volume c00c8458-9e86-4d95-aa03-d423c58ae331: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c00c8458-9e86-4d95-aa03-d423c58ae331', 'volume_size': 1} Sep 07 13:51:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1023907703',display_name='tempest-VolumesGetTest-Volume-1132672844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00c8458-9e86-4d95-aa03-d423c58ae331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad578935552d4d118f97a8607eba93f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:06Z,use_quota=True,user_id='5e4cd642ccf14bc3b0fdf3ad26e0e592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:51:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Creating volume c00c8458-9e86-4d95-aa03-d423c58ae331 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:51:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:51:06 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:51:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c00c8458-9e86-4d95-aa03-d423c58ae331 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:06 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c00c8458-9e86-4d95-aa03-d423c58ae331 1073741824 Sep 07 13:51:06 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:07 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c00c8458-9e86-4d95-aa03-d423c58ae331 1073741824" returned: 0 in 0.593s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c00c8458-9e86-4d95-aa03-d423c58ae331 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:07 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c00c8458-9e86-4d95-aa03-d423c58ae331 Sep 07 13:51:07 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:07 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c00c8458-9e86-4d95-aa03-d423c58ae331" returned: 0 in 0.364s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:51:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360cdd11-ed41-4c6b-96ab-4848a4dd978f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c00c8458-9e86-4d95-aa03-d423c58ae331', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a36fd86c-678f-4086-8553-0df6db87d26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:07 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Volume volume-c00c8458-9e86-4d95-aa03-d423c58ae331 (c00c8458-9e86-4d95-aa03-d423c58ae331): created successfully Sep 07 13:51:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a36fd86c-678f-4086-8553-0df6db87d26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Flow 'volume_create_manager' (fe590403-ea2c-4b23-84a0-9a00b92961a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:07 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-28479267-ed51-4ccc-a5c7-c3e99f2ace03 tempest-VolumesGetTest-1424992239 None] Created volume successfully. Sep 07 13:51:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-999df91d-1b1a-4990-8823-65aeed758f02 tempest-VolumesGetTest-1424992239 None] Acquiring lock "cinder-c00c8458-9e86-4d95-aa03-d423c58ae331-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-999df91d-1b1a-4990-8823-65aeed758f02 tempest-VolumesGetTest-1424992239 None] Lock "cinder-c00c8458-9e86-4d95-aa03-d423c58ae331-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-999df91d-1b1a-4990-8823-65aeed758f02 tempest-VolumesGetTest-1424992239 None] Acquiring lock "cinder-quobyte-c00c8458-9e86-4d95-aa03-d423c58ae331" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-999df91d-1b1a-4990-8823-65aeed758f02 tempest-VolumesGetTest-1424992239 None] Lock "cinder-quobyte-c00c8458-9e86-4d95-aa03-d423c58ae331" acquired by "delete_volume" :: waited 0.026s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:08 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[103723f0-c85d-4012-a9d3-e2643b37b811]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-999df91d-1b1a-4990-8823-65aeed758f02 tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c00c8458-9e86-4d95-aa03-d423c58ae331 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:09 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c00c8458-9e86-4d95-aa03-d423c58ae331 Sep 07 13:51:09 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:09 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-999df91d-1b1a-4990-8823-65aeed758f02 tempest-VolumesGetTest-1424992239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c00c8458-9e86-4d95-aa03-d423c58ae331" returned: 0 in 0.455s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-999df91d-1b1a-4990-8823-65aeed758f02 tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c00c8458-9e86-4d95-aa03-d423c58ae331 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:09 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c00c8458-9e86-4d95-aa03-d423c58ae331 Sep 07 13:51:09 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:09 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-999df91d-1b1a-4990-8823-65aeed758f02 tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c00c8458-9e86-4d95-aa03-d423c58ae331" returned: 0 in 0.479s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-999df91d-1b1a-4990-8823-65aeed758f02 tempest-VolumesGetTest-1424992239 None] Lock "cinder-quobyte-c00c8458-9e86-4d95-aa03-d423c58ae331" released by "delete_volume" :: held 0.990s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:09 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=104,cinder:UPDATE=136,cinder:INSERT=42,cinder:DELETE=8 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:51:10 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=110,cinder:INSERT=36,cinder:UPDATE=145,cinder:DELETE=18 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:51:10 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-999df91d-1b1a-4990-8823-65aeed758f02 tempest-VolumesGetTest-1424992239 None] Created reservations ['77f90c0f-cb12-47f8-9220-d83e0f6fc00d', '46b002ea-049f-4e93-aa59-9d27807a6cb2', 'aba0ca67-90b0-420d-9df2-baac398e168b', '13a03d21-3570-4dc0-af36-4e2960981e5d'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:51:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-999df91d-1b1a-4990-8823-65aeed758f02 tempest-VolumesGetTest-1424992239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-999df91d-1b1a-4990-8823-65aeed758f02 tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-999df91d-1b1a-4990-8823-65aeed758f02 tempest-VolumesGetTest-1424992239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-999df91d-1b1a-4990-8823-65aeed758f02 tempest-VolumesGetTest-1424992239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-999df91d-1b1a-4990-8823-65aeed758f02 tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-999df91d-1b1a-4990-8823-65aeed758f02 tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:10 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:51:10 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:10 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-999df91d-1b1a-4990-8823-65aeed758f02 tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.330s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:10 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-999df91d-1b1a-4990-8823-65aeed758f02 tempest-VolumesGetTest-1424992239 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:51:10 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-999df91d-1b1a-4990-8823-65aeed758f02 tempest-VolumesGetTest-1424992239 None] Deleted volume successfully. Sep 07 13:51:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-999df91d-1b1a-4990-8823-65aeed758f02 tempest-VolumesGetTest-1424992239 None] Lock "cinder-c00c8458-9e86-4d95-aa03-d423c58ae331-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e30ccf1e-250e-44ad-824b-ed0e84be7710 tempest-VolumesGetTest-1424992239 None] Acquiring lock "cinder-5bc362e1-bb32-470a-82f0-2c7162a0a4c9-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e30ccf1e-250e-44ad-824b-ed0e84be7710 tempest-VolumesGetTest-1424992239 None] Lock "cinder-5bc362e1-bb32-470a-82f0-2c7162a0a4c9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e30ccf1e-250e-44ad-824b-ed0e84be7710 tempest-VolumesGetTest-1424992239 None] Acquiring lock "cinder-quobyte-5bc362e1-bb32-470a-82f0-2c7162a0a4c9" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e30ccf1e-250e-44ad-824b-ed0e84be7710 tempest-VolumesGetTest-1424992239 None] Lock "cinder-quobyte-5bc362e1-bb32-470a-82f0-2c7162a0a4c9" acquired by "delete_volume" :: waited 0.031s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:11 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3bcaf1-9bd9-498f-ad20-8adc22246f48]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e30ccf1e-250e-44ad-824b-ed0e84be7710 tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bc362e1-bb32-470a-82f0-2c7162a0a4c9 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:11 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bc362e1-bb32-470a-82f0-2c7162a0a4c9 Sep 07 13:51:11 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:11 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:51:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Flow 'volume_create_manager' (8f14941e-eaf3-4e70-9672-017f55a4d35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e59323-9147-4624-8384-e62c34285d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e59323-9147-4624-8384-e62c34285d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-775304032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7cca54-663b-45f0-9be2-3e029f861f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e68c4f101874012a0b7e7792f5fdc12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:12Z,use_quota=True,user_id='b82eb68e2d06499081d04b9c12e42b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf8bf6a-e50c-4397-995b-92bf1b9dca6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf8bf6a-e50c-4397-995b-92bf1b9dca6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a2c7799-068f-4046-ab16-e5ad6823e607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a2c7799-068f-4046-ab16-e5ad6823e607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f7cca54-663b-45f0-9be2-3e029f861f78', 'volume_name': 'volume-3f7cca54-663b-45f0-9be2-3e029f861f78', 'volume_size': 2}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3732d4fa-47bc-49a6-8ff5-a7e4d3a34aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3732d4fa-47bc-49a6-8ff5-a7e4d3a34aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56aa3dd-1067-4bd6-bc52-dfad96911a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:12 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Volume 3f7cca54-663b-45f0-9be2-3e029f861f78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f7cca54-663b-45f0-9be2-3e029f861f78', 'volume_size': 2} Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-775304032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7cca54-663b-45f0-9be2-3e029f861f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e68c4f101874012a0b7e7792f5fdc12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:12Z,use_quota=True,user_id='b82eb68e2d06499081d04b9c12e42b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Creating volume 3f7cca54-663b-45f0-9be2-3e029f861f78 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:51:12 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f7cca54-663b-45f0-9be2-3e029f861f78 2147483648 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:12 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f7cca54-663b-45f0-9be2-3e029f861f78 2147483648 Sep 07 13:51:12 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:12 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e30ccf1e-250e-44ad-824b-ed0e84be7710 tempest-VolumesGetTest-1424992239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bc362e1-bb32-470a-82f0-2c7162a0a4c9" returned: 0 in 0.714s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e30ccf1e-250e-44ad-824b-ed0e84be7710 tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bc362e1-bb32-470a-82f0-2c7162a0a4c9 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:12 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bc362e1-bb32-470a-82f0-2c7162a0a4c9 Sep 07 13:51:12 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:12 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e30ccf1e-250e-44ad-824b-ed0e84be7710 tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bc362e1-bb32-470a-82f0-2c7162a0a4c9" returned: 0 in 0.443s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e30ccf1e-250e-44ad-824b-ed0e84be7710 tempest-VolumesGetTest-1424992239 None] Lock "cinder-quobyte-5bc362e1-bb32-470a-82f0-2c7162a0a4c9" released by "delete_volume" :: held 1.225s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-e30ccf1e-250e-44ad-824b-ed0e84be7710 tempest-VolumesGetTest-1424992239 None] Created reservations ['de065664-2dc6-4a7f-a9b8-438fbd45b46d', '82a4047a-6328-4544-bbc5-39f4ab703eb8', '3b0e680b-ca67-4989-865b-5f97ad0116af', 'de3600c6-ee8c-4b40-b13b-4180bd63767e'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e30ccf1e-250e-44ad-824b-ed0e84be7710 tempest-VolumesGetTest-1424992239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e30ccf1e-250e-44ad-824b-ed0e84be7710 tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e30ccf1e-250e-44ad-824b-ed0e84be7710 tempest-VolumesGetTest-1424992239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e30ccf1e-250e-44ad-824b-ed0e84be7710 tempest-VolumesGetTest-1424992239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e30ccf1e-250e-44ad-824b-ed0e84be7710 tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e30ccf1e-250e-44ad-824b-ed0e84be7710 tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:12 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f7cca54-663b-45f0-9be2-3e029f861f78 2147483648" returned: 0 in 0.944s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:12 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:51:13 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f7cca54-663b-45f0-9be2-3e029f861f78 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:13 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f7cca54-663b-45f0-9be2-3e029f861f78 Sep 07 13:51:13 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:13 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e30ccf1e-250e-44ad-824b-ed0e84be7710 tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.428s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:13 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-e30ccf1e-250e-44ad-824b-ed0e84be7710 tempest-VolumesGetTest-1424992239 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:51:13 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-e30ccf1e-250e-44ad-824b-ed0e84be7710 tempest-VolumesGetTest-1424992239 None] Deleted volume successfully. Sep 07 13:51:13 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f7cca54-663b-45f0-9be2-3e029f861f78" returned: 0 in 0.408s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:13 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:51:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e30ccf1e-250e-44ad-824b-ed0e84be7710 tempest-VolumesGetTest-1424992239 None] Lock "cinder-5bc362e1-bb32-470a-82f0-2c7162a0a4c9-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56aa3dd-1067-4bd6-bc52-dfad96911a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f7cca54-663b-45f0-9be2-3e029f861f78', 'volume_size': 2}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f36be688-dea9-4d1c-a9ac-db7b02769d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:13 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Volume volume-3f7cca54-663b-45f0-9be2-3e029f861f78 (3f7cca54-663b-45f0-9be2-3e029f861f78): created successfully Sep 07 13:51:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f36be688-dea9-4d1c-a9ac-db7b02769d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Flow 'volume_create_manager' (8f14941e-eaf3-4e70-9672-017f55a4d35f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:13 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-81fb8acb-ae73-4f83-8340-70835551cb27 tempest-VolumesCloneNegativeTest-1831110264 None] Created volume successfully. Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e4f51dbb-2394-4b48-af44-f4954f950e67 tempest-VolumesCloneNegativeTest-1831110264 None] Acquiring lock "cinder-3f7cca54-663b-45f0-9be2-3e029f861f78-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e4f51dbb-2394-4b48-af44-f4954f950e67 tempest-VolumesCloneNegativeTest-1831110264 None] Lock "cinder-3f7cca54-663b-45f0-9be2-3e029f861f78-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e4f51dbb-2394-4b48-af44-f4954f950e67 tempest-VolumesCloneNegativeTest-1831110264 None] Acquiring lock "cinder-quobyte-3f7cca54-663b-45f0-9be2-3e029f861f78" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e4f51dbb-2394-4b48-af44-f4954f950e67 tempest-VolumesCloneNegativeTest-1831110264 None] Lock "cinder-quobyte-3f7cca54-663b-45f0-9be2-3e029f861f78" acquired by "delete_volume" :: waited 0.038s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ea413f-b07c-4404-9536-9e8b68b45dda]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e4f51dbb-2394-4b48-af44-f4954f950e67 tempest-VolumesCloneNegativeTest-1831110264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f7cca54-663b-45f0-9be2-3e029f861f78 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:14 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f7cca54-663b-45f0-9be2-3e029f861f78 Sep 07 13:51:14 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Flow 'volume_create_manager' (e39ccdd0-42c4-44bf-afd1-91a76e3c6cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0222328f-f851-495c-89a3-8425f4491856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0222328f-f851-495c-89a3-8425f4491856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-730667024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94031e4-acd1-4be9-9634-7f7d702e772d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad578935552d4d118f97a8607eba93f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:14Z,use_quota=True,user_id='5e4cd642ccf14bc3b0fdf3ad26e0e592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03cf79e8-3bad-474b-8610-866fd8c55520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03cf79e8-3bad-474b-8610-866fd8c55520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b90cc73-0485-46e4-8f77-daac6210d0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b90cc73-0485-46e4-8f77-daac6210d0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b94031e4-acd1-4be9-9634-7f7d702e772d', 'volume_name': 'volume-b94031e4-acd1-4be9-9634-7f7d702e772d', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e11ae9-e32c-4d02-8535-5e29cbcd713b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e11ae9-e32c-4d02-8535-5e29cbcd713b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926d2321-7240-42ea-aafc-511c5eac7a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:14 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Volume b94031e4-acd1-4be9-9634-7f7d702e772d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b94031e4-acd1-4be9-9634-7f7d702e772d', 'volume_size': 1} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-730667024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94031e4-acd1-4be9-9634-7f7d702e772d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad578935552d4d118f97a8607eba93f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:14Z,use_quota=True,user_id='5e4cd642ccf14bc3b0fdf3ad26e0e592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Creating volume b94031e4-acd1-4be9-9634-7f7d702e772d {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:51:14 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:14 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d 1073741824 Sep 07 13:51:14 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:14 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e4f51dbb-2394-4b48-af44-f4954f950e67 tempest-VolumesCloneNegativeTest-1831110264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f7cca54-663b-45f0-9be2-3e029f861f78" returned: 0 in 0.498s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e4f51dbb-2394-4b48-af44-f4954f950e67 tempest-VolumesCloneNegativeTest-1831110264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f7cca54-663b-45f0-9be2-3e029f861f78 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:14 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f7cca54-663b-45f0-9be2-3e029f861f78 Sep 07 13:51:14 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:15 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e4f51dbb-2394-4b48-af44-f4954f950e67 tempest-VolumesCloneNegativeTest-1831110264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f7cca54-663b-45f0-9be2-3e029f861f78" returned: 0 in 0.325s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e4f51dbb-2394-4b48-af44-f4954f950e67 tempest-VolumesCloneNegativeTest-1831110264 None] Lock "cinder-quobyte-3f7cca54-663b-45f0-9be2-3e029f861f78" released by "delete_volume" :: held 0.895s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:15 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:15 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-e4f51dbb-2394-4b48-af44-f4954f950e67 tempest-VolumesCloneNegativeTest-1831110264 None] Created reservations ['7ce9ad54-ff67-4020-a8c6-d89b06a0f812', '98cb0a76-e9cb-4f94-9094-3df864bd84e6', 'c7cf3394-c60d-48c7-a095-20ff3f12423e', 'd5207872-4d07-4fdb-a470-d00a2b3d4894'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:51:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d 1073741824" returned: 0 in 0.605s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:15 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d Sep 07 13:51:15 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e4f51dbb-2394-4b48-af44-f4954f950e67 tempest-VolumesCloneNegativeTest-1831110264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e4f51dbb-2394-4b48-af44-f4954f950e67 tempest-VolumesCloneNegativeTest-1831110264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e4f51dbb-2394-4b48-af44-f4954f950e67 tempest-VolumesCloneNegativeTest-1831110264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e4f51dbb-2394-4b48-af44-f4954f950e67 tempest-VolumesCloneNegativeTest-1831110264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e4f51dbb-2394-4b48-af44-f4954f950e67 tempest-VolumesCloneNegativeTest-1831110264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e4f51dbb-2394-4b48-af44-f4954f950e67 tempest-VolumesCloneNegativeTest-1831110264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:15 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:51:15 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:15 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d" returned: 0 in 0.352s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:51:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926d2321-7240-42ea-aafc-511c5eac7a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b94031e4-acd1-4be9-9634-7f7d702e772d', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c23985-f72f-482f-b29b-9f5f8ca4faa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:15 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:15 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Volume volume-b94031e4-acd1-4be9-9634-7f7d702e772d (b94031e4-acd1-4be9-9634-7f7d702e772d): created successfully Sep 07 13:51:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c23985-f72f-482f-b29b-9f5f8ca4faa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Flow 'volume_create_manager' (e39ccdd0-42c4-44bf-afd1-91a76e3c6cd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e4f51dbb-2394-4b48-af44-f4954f950e67 tempest-VolumesCloneNegativeTest-1831110264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.390s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:15 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-e4f51dbb-2394-4b48-af44-f4954f950e67 tempest-VolumesCloneNegativeTest-1831110264 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:51:15 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-e4f51dbb-2394-4b48-af44-f4954f950e67 tempest-VolumesCloneNegativeTest-1831110264 None] Deleted volume successfully. Sep 07 13:51:15 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-0a9a5b70-3054-45e1-a0c5-e78d58d323f7 tempest-VolumesGetTest-1424992239 None] Created volume successfully. Sep 07 13:51:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e4f51dbb-2394-4b48-af44-f4954f950e67 tempest-VolumesCloneNegativeTest-1831110264 None] Lock "cinder-3f7cca54-663b-45f0-9be2-3e029f861f78-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:17 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:51:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Flow 'volume_create_manager' (567a4e40-691b-42fc-bd4b-4a1656ed0471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (641e2b42-e367-4252-995b-8c2e099c7fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (641e2b42-e367-4252-995b-8c2e099c7fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-178453920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32e6b19-9dbd-4df2-bcbc-2ec035426be6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ad578935552d4d118f97a8607eba93f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b94031e4-acd1-4be9-9634-7f7d702e772d,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:17Z,use_quota=True,user_id='5e4cd642ccf14bc3b0fdf3ad26e0e592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52dcb143-c99f-4ab9-9d9f-1a589ee467e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52dcb143-c99f-4ab9-9d9f-1a589ee467e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b176536-fccd-469d-9a70-fef07677f045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b176536-fccd-469d-9a70-fef07677f045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c32e6b19-9dbd-4df2-bcbc-2ec035426be6', 'volume_name': 'volume-c32e6b19-9dbd-4df2-bcbc-2ec035426be6', 'volume_size': 1, 'source_volid': 'b94031e4-acd1-4be9-9634-7f7d702e772d', 'source_volstatus': 'available'}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0a9ea8-6080-40a9-ba4d-e79a1ec9abea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0a9ea8-6080-40a9-ba4d-e79a1ec9abea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49e3ea1-23cc-459a-ab78-f2990b894acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:17 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Volume c32e6b19-9dbd-4df2-bcbc-2ec035426be6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c32e6b19-9dbd-4df2-bcbc-2ec035426be6', 'volume_size': 1, 'source_volid': 'b94031e4-acd1-4be9-9634-7f7d702e772d', 'source_volstatus': 'available'} Sep 07 13:51:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:17 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Cloning volume b94031e4-acd1-4be9-9634-7f7d702e772d to volume c32e6b19-9dbd-4df2-bcbc-2ec035426be6 Sep 07 13:51:17 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Creating offline snapshot bb26db0d-a373-43e9-b072-27867d131c20 of volume b94031e4-acd1-4be9-9634-7f7d702e772d {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:51:17 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf6697a-924e-4390-9ccc-f80bc5eda1ee]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:17 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d Sep 07 13:51:17 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:18 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d" returned: 0 in 0.615s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.bb26db0d-a373-43e9-b072-27867d131c20 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:18 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.bb26db0d-a373-43e9-b072-27867d131c20 1G Sep 07 13:51:18 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:19 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.bb26db0d-a373-43e9-b072-27867d131c20 1G" returned: 0 in 0.837s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b94031e4-acd1-4be9-9634-7f7d702e772d -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.bb26db0d-a373-43e9-b072-27867d131c20 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:19 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b94031e4-acd1-4be9-9634-7f7d702e772d -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.bb26db0d-a373-43e9-b072-27867d131c20 Sep 07 13:51:19 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:19 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b94031e4-acd1-4be9-9634-7f7d702e772d -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.bb26db0d-a373-43e9-b072-27867d131c20" returned: 0 in 0.454s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:19 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.bb26db0d-a373-43e9-b072-27867d131c20 is being set with open permissions: ugo+rw Sep 07 13:51:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.bb26db0d-a373-43e9-b072-27867d131c20 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:19 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.bb26db0d-a373-43e9-b072-27867d131c20 Sep 07 13:51:19 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:19 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.bb26db0d-a373-43e9-b072-27867d131c20" returned: 0 in 0.324s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:20 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.info Sep 07 13:51:20 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:20 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.info" returned: 0 in 0.307s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:20 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.info is being set with open permissions: ugo+rw Sep 07 13:51:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:20 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.info Sep 07 13:51:20 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:20 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.info" returned: 0 in 0.432s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Acquiring lock "cinder-quobyte-c32e6b19-9dbd-4df2-bcbc-2ec035426be6" by "_copy_volume_from_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Lock "cinder-quobyte-c32e6b19-9dbd-4df2-bcbc-2ec035426be6" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] snapshot: bb26db0d-a373-43e9-b072-27867d131c20, volume: c32e6b19-9dbd-4df2-bcbc-2ec035426be6, {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 13:51:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-96019ad8-40ad-4695-b226-14f5f41c1927 req-fa112877-f12d-4e5c-addf-29ed57b454cb tempest-AttachVolumeShelveTestJSON-925670451 None] No connector for attachment fcd49fc6-c0b3-455a-b0b0-cacdabb0eee5; skipping storage backend terminate_connection call. {{(pid=87571) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 07 13:51:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-96019ad8-40ad-4695-b226-14f5f41c1927 req-fa112877-f12d-4e5c-addf-29ed57b454cb tempest-AttachVolumeShelveTestJSON-925670451 None] Deleting attachment fcd49fc6-c0b3-455a-b0b0-cacdabb0eee5. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:51:20 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d43675-3f55-4a58-b44d-40e018a71362]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.bb26db0d-a373-43e9-b072-27867d131c20 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:21 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.bb26db0d-a373-43e9-b072-27867d131c20 Sep 07 13:51:21 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:21 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.bb26db0d-a373-43e9-b072-27867d131c20" returned: 0 in 0.445s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b94031e4-acd1-4be9-9634-7f7d702e772d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:51:21 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c106a0bd-b3f5-484b-9194-bc1036b2281a]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:21 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d Sep 07 13:51:21 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:21 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d" returned: 0 in 0.595s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 13:51:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Creating direct copy from snapshot {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 13:51:21 devstack cinder-volume[87571]: DEBUG cinder.utils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Path /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c32e6b19-9dbd-4df2-bcbc-2ec035426be6 not found in is_blk_device check {{(pid=87571) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 13:51:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c32e6b19-9dbd-4df2-bcbc-2ec035426be6 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:22 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c32e6b19-9dbd-4df2-bcbc-2ec035426be6 Sep 07 13:51:22 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:24 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:51:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Flow 'volume_create_manager' (6a661a2c-2f92-49d3-8957-f85c90823a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9bf4c7-68a5-4544-b7ef-19720d22ecd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9bf4c7-68a5-4544-b7ef-19720d22ecd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2054035733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664cac84-7c2e-4092-a58f-4219c6065d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f52a55aeb0a4f548323fe5003d8bdc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:24Z,use_quota=True,user_id='c647a47e110b47e187bab37a50f1c203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (239fdcbf-3f5f-4a0b-b4f2-88e17bda0825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (239fdcbf-3f5f-4a0b-b4f2-88e17bda0825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fceb264a-c646-43ee-8597-a125577ba73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:24 devstack cinder-volume[87571]: DEBUG cinder.image.glance [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Creating Keystone auth plugin from conf {{(pid=87571) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 13:51:24 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:51:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Flow 'volume_create_manager' (237a0e4a-5598-4ba0-a88d-7a90b843b3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b04c024f-dfec-4381-83e3-15d86f0a6d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b04c024f-dfec-4381-83e3-15d86f0a6d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-218439955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06640ff1-4859-4902-975f-3942e2680104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2a9ce076024a3aa391aafaaca43888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:24Z,use_quota=True,user_id='5e2f684320d44acda48fd77029a40557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a85ed9a-b4f4-49bf-9776-8a5e7762b929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a85ed9a-b4f4-49bf-9776-8a5e7762b929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c120f20-15b1-4f54-b6a1-ffc27fa7017d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:24 devstack cinder-volume[87571]: DEBUG cinder.image.glance [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Creating Keystone auth plugin from conf {{(pid=87571) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 13:51:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fceb264a-c646-43ee-8597-a125577ba73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '664cac84-7c2e-4092-a58f-4219c6065d08', 'volume_name': 'volume-664cac84-7c2e-4092-a58f-4219c6065d08', 'volume_size': 1, 'image_id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d9d2114dd14b01a04867c896fdabaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'created_at': datetime.datetime(2026, 9, 7, 11, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdbd1541-2076-47bf-b26a-15662727e644/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c28bc0-e30c-4735-ba41-4fe6f3e57861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c28bc0-e30c-4735-ba41-4fe6f3e57861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76aaf3ad-a18b-417e-a537-333cb8bde02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:25 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Volume 664cac84-7c2e-4092-a58f-4219c6065d08: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-664cac84-7c2e-4092-a58f-4219c6065d08', 'volume_size': 1, 'image_id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d9d2114dd14b01a04867c896fdabaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'created_at': datetime.datetime(2026, 9, 7, 11, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdbd1541-2076-47bf-b26a-15662727e644/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 13:51:25 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Trying to clone 664cac84-7c2e-4092-a58f-4219c6065d08 from image bdbd1541-2076-47bf-b26a-15662727e644 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}]). {{(pid=87571) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1099}} Sep 07 13:51:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c120f20-15b1-4f54-b6a1-ffc27fa7017d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '06640ff1-4859-4902-975f-3942e2680104', 'volume_name': 'volume-06640ff1-4859-4902-975f-3942e2680104', 'volume_size': 1, 'image_id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d9d2114dd14b01a04867c896fdabaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'created_at': datetime.datetime(2026, 9, 7, 11, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdbd1541-2076-47bf-b26a-15662727e644/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b131dae-402a-49b7-a3eb-2d5d6b9a1707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b131dae-402a-49b7-a3eb-2d5d6b9a1707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4795f4-79b9-46c1-ba5e-887d5afd86be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:25 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Volume 06640ff1-4859-4902-975f-3942e2680104: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-06640ff1-4859-4902-975f-3942e2680104', 'volume_size': 1, 'image_id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d9d2114dd14b01a04867c896fdabaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'created_at': datetime.datetime(2026, 9, 7, 11, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdbd1541-2076-47bf-b26a-15662727e644/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 13:51:25 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Trying to clone 06640ff1-4859-4902-975f-3942e2680104 from image bdbd1541-2076-47bf-b26a-15662727e644 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}]). {{(pid=87571) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1099}} Sep 07 13:51:26 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_nbeeliikdevstack@QuobyteHD, size 20.69 MB, duration 1.03 sec {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 13:51:26 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Image download 20.69 MB at 20.01 MB/s Sep 07 13:51:26 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_5yq_i1c4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 13:51:26 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Image download 20.69 MB at 20.69 MB/s Sep 07 13:51:26 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbc37bd-26c6-4143-a24a-7c2a734b1cec]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_nbeeliikdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:26 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a55b9c-e660-44c4-a2ba-38d7dbccddb3]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_5yq_i1c4devstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:26 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_nbeeliikdevstack@QuobyteHD Sep 07 13:51:26 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_5yq_i1c4devstack@QuobyteHD Sep 07 13:51:26 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:26 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:27 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_5yq_i1c4devstack@QuobyteHD" returned: 0 in 1.019s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:27 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Temporary image bdbd1541-2076-47bf-b26a-15662727e644 is fetched for user 5e2f684320d44acda48fd77029a40557. {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 13:51:27 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_nbeeliikdevstack@QuobyteHD" returned: 0 in 1.232s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:27 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Temporary image bdbd1541-2076-47bf-b26a-15662727e644 is fetched for user c647a47e110b47e187bab37a50f1c203. {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 13:51:27 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9187c9c1-45f9-46d3-b190-72ab5d98c5df]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_5yq_i1c4devstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:27 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[071b60fd-2935-4d95-b7c6-03702e50e746]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_nbeeliikdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:28 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_5yq_i1c4devstack@QuobyteHD Sep 07 13:51:28 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:28 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_5yq_i1c4devstack@QuobyteHD" returned: 0 in 0.471s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:28 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_nbeeliikdevstack@QuobyteHD Sep 07 13:51:28 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:28 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c32e6b19-9dbd-4df2-bcbc-2ec035426be6" returned: 0 in 6.347s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c32e6b19-9dbd-4df2-bcbc-2ec035426be6 {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:51:28 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Converted 1024.00 MB image at 161.23 MB/s Sep 07 13:51:28 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c32e6b19-9dbd-4df2-bcbc-2ec035426be6 is being set with open permissions: ugo+rw Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c32e6b19-9dbd-4df2-bcbc-2ec035426be6 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:28 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:51:28 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:28 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c32e6b19-9dbd-4df2-bcbc-2ec035426be6 Sep 07 13:51:28 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:28 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_nbeeliikdevstack@QuobyteHD" returned: 0 in 0.650s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:28 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c32e6b19-9dbd-4df2-bcbc-2ec035426be6" returned: 0 in 0.275s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Lock "cinder-quobyte-c32e6b19-9dbd-4df2-bcbc-2ec035426be6" released by "_copy_volume_from_snapshot" :: held 7.771s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:28 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.310s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Acquiring lock "cinder-quobyte-bb26db0d-a373-43e9-b072-27867d131c20" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager._thread_info {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread count: 28 {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread info: [<_MainThread(MainThread, started 132147689414784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Lock "cinder-quobyte-bb26db0d-a373-43e9-b072-27867d131c20" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Deleting offline snapshot bb26db0d-a373-43e9-b072-27867d131c20 of volume b94031e4-acd1-4be9-9634-7f7d702e772d {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] snapshot_file for this snap is: volume-b94031e4-acd1-4be9-9634-7f7d702e772d.bb26db0d-a373-43e9-b072-27867d131c20 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ce3c2c-e8ff-4a87-a166-e2729b86526e]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.bb26db0d-a373-43e9-b072-27867d131c20 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:28 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.bb26db0d-a373-43e9-b072-27867d131c20 Sep 07 13:51:28 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:29 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.bb26db0d-a373-43e9-b072-27867d131c20" returned: 0 in 0.377s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b94031e4-acd1-4be9-9634-7f7d702e772d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:51:29 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1314c2-61da-43f8-9f5d-675336ebfc48]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:29 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d Sep 07 13:51:29 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:29 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d" returned: 0 in 0.555s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.bb26db0d-a373-43e9-b072-27867d131c20 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:29 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.bb26db0d-a373-43e9-b072-27867d131c20 Sep 07 13:51:29 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:30 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.bb26db0d-a373-43e9-b072-27867d131c20" returned: 0 in 0.399s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.bb26db0d-a373-43e9-b072-27867d131c20 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:30 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.bb26db0d-a373-43e9-b072-27867d131c20 Sep 07 13:51:30 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:30 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d.bb26db0d-a373-43e9-b072-27867d131c20" returned: 0 in 0.259s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Lock "cinder-quobyte-bb26db0d-a373-43e9-b072-27867d131c20" released by "_delete_snapshot" :: held 1.693s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.818s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.112s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-218439955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06640ff1-4859-4902-975f-3942e2680104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2a9ce076024a3aa391aafaaca43888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:24Z,use_quota=True,user_id='5e2f684320d44acda48fd77029a40557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:51:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Creating volume 06640ff1-4859-4902-975f-3942e2680104 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:51:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:51:30 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:51:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49e3ea1-23cc-459a-ab78-f2990b894acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c32e6b19-9dbd-4df2-bcbc-2ec035426be6', 'volume_size': 1, 'source_volid': 'b94031e4-acd1-4be9-9634-7f7d702e772d', 'source_volstatus': 'available'}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81f03a81-bef7-4420-9e83-2def73673e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:30 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104 1073741824 Sep 07 13:51:30 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:30 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Volume volume-c32e6b19-9dbd-4df2-bcbc-2ec035426be6 (c32e6b19-9dbd-4df2-bcbc-2ec035426be6): created successfully Sep 07 13:51:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81f03a81-bef7-4420-9e83-2def73673e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Flow 'volume_create_manager' (567a4e40-691b-42fc-bd4b-4a1656ed0471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:30 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-1c61aee0-3c92-4c23-b725-fe4fdd8356bb tempest-VolumesGetTest-1424992239 None] Created volume successfully. Sep 07 13:51:30 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104 1073741824" returned: 0 in 0.458s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:30 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104 Sep 07 13:51:30 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:31 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104" returned: 0 in 0.273s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:51:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.598s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2054035733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664cac84-7c2e-4092-a58f-4219c6065d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f52a55aeb0a4f548323fe5003d8bdc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:24Z,use_quota=True,user_id='c647a47e110b47e187bab37a50f1c203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:51:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Creating volume 664cac84-7c2e-4092-a58f-4219c6065d08 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:51:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:51:31 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:51:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-664cac84-7c2e-4092-a58f-4219c6065d08 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:31 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-664cac84-7c2e-4092-a58f-4219c6065d08 1073741824 Sep 07 13:51:31 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:31 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Attempting download of bdbd1541-2076-47bf-b26a-15662727e644 ((None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}])) to volume 06640ff1-4859-4902-975f-3942e2680104. {{(pid=87571) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 13:51:31 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b765c5b9-26bb-4460-abad-c3291a79e112]: (4, 'raw') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_m2vwc5w5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:31 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_m2vwc5w5 Sep 07 13:51:31 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:31 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_m2vwc5w5" returned: 0 in 0.404s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_m2vwc5w5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:31 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-664cac84-7c2e-4092-a58f-4219c6065d08 1073741824" returned: 0 in 0.546s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-664cac84-7c2e-4092-a58f-4219c6065d08 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:31 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-664cac84-7c2e-4092-a58f-4219c6065d08 Sep 07 13:51:31 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:31 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_m2vwc5w5 Sep 07 13:51:31 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:32 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_m2vwc5w5" returned: 1 in 0.395s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_m2vwc5w5' failed. Not Retrying. {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0957c4-fe7f-4209-bfc9-cfa7c4c2150d]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_5yq_i1c4devstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:32 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-664cac84-7c2e-4092-a58f-4219c6065d08" returned: 0 in 0.444s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:32 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_5yq_i1c4devstack@QuobyteHD Sep 07 13:51:32 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Attempting download of bdbd1541-2076-47bf-b26a-15662727e644 ((None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}])) to volume 664cac84-7c2e-4092-a58f-4219c6065d08. {{(pid=87571) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3897227-2d1a-4bb5-8eb8-453c11a09108]: (4, 'raw') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_onphudoe {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Flow 'volume_create_manager' (69d821cc-3b06-48c2-b6cb-805302a4b92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99040ce8-ff6e-4a0d-8f37-64a6e36fe15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99040ce8-ff6e-4a0d-8f37-64a6e36fe15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-565231704',display_name='tempest-VolumesGetTest-Volume-821691420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fad360d-b448-4556-9a71-a606c7b7c489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad578935552d4d118f97a8607eba93f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:32Z,use_quota=True,user_id='5e4cd642ccf14bc3b0fdf3ad26e0e592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a4a5b3-1ce0-478d-9a58-ef5b8be0e1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a4a5b3-1ce0-478d-9a58-ef5b8be0e1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d36fcc-644d-41d2-9f6b-334b50b86da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d36fcc-644d-41d2-9f6b-334b50b86da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fad360d-b448-4556-9a71-a606c7b7c489', 'volume_name': 'volume-6fad360d-b448-4556-9a71-a606c7b7c489', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c1771c3-b921-495c-9854-02d12f145fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c1771c3-b921-495c-9854-02d12f145fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:32 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_onphudoe Sep 07 13:51:32 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f807d1-a339-4909-9fc8-145b090ccd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:32 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Volume 6fad360d-b448-4556-9a71-a606c7b7c489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fad360d-b448-4556-9a71-a606c7b7c489', 'volume_size': 1} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-565231704',display_name='tempest-VolumesGetTest-Volume-821691420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fad360d-b448-4556-9a71-a606c7b7c489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad578935552d4d118f97a8607eba93f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:32Z,use_quota=True,user_id='5e4cd642ccf14bc3b0fdf3ad26e0e592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Creating volume 6fad360d-b448-4556-9a71-a606c7b7c489 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:51:32 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6fad360d-b448-4556-9a71-a606c7b7c489 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:32 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6fad360d-b448-4556-9a71-a606c7b7c489 1073741824 Sep 07 13:51:32 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:32 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_5yq_i1c4devstack@QuobyteHD" returned: 0 in 0.472s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] bdbd1541-2076-47bf-b26a-15662727e644 was qcow2, converting to qcow2 {{(pid=87571) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_5yq_i1c4devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:32 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_5yq_i1c4devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104 Sep 07 13:51:32 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:32 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_onphudoe" returned: 0 in 0.512s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_onphudoe {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:33 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_onphudoe Sep 07 13:51:33 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:33 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6fad360d-b448-4556-9a71-a606c7b7c489 1073741824" returned: 0 in 0.569s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6fad360d-b448-4556-9a71-a606c7b7c489 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:33 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6fad360d-b448-4556-9a71-a606c7b7c489 Sep 07 13:51:33 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:33 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_onphudoe" returned: 1 in 0.421s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_onphudoe' failed. Not Retrying. {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 13:51:33 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf29020-299a-4e79-8c6b-5a14818258fe]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_nbeeliikdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:33 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_nbeeliikdevstack@QuobyteHD Sep 07 13:51:33 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:33 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6fad360d-b448-4556-9a71-a606c7b7c489" returned: 0 in 0.287s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:51:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f807d1-a339-4909-9fc8-145b090ccd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fad360d-b448-4556-9a71-a606c7b7c489', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d00fb8-a2fc-4e7c-b9c4-50d2512ab914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:33 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Volume volume-6fad360d-b448-4556-9a71-a606c7b7c489 (6fad360d-b448-4556-9a71-a606c7b7c489): created successfully Sep 07 13:51:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d00fb8-a2fc-4e7c-b9c4-50d2512ab914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Flow 'volume_create_manager' (69d821cc-3b06-48c2-b6cb-805302a4b92a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:33 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-d80784c6-5698-46a2-bb25-3a7e5d81925b tempest-VolumesGetTest-1424992239 None] Created volume successfully. Sep 07 13:51:33 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_nbeeliikdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:33 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] bdbd1541-2076-47bf-b26a-15662727e644 was qcow2, converting to qcow2 {{(pid=87571) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 13:51:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_nbeeliikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-664cac84-7c2e-4092-a58f-4219c6065d08 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:33 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_nbeeliikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-664cac84-7c2e-4092-a58f-4219c6065d08 Sep 07 13:51:33 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1ab96961-c572-4726-b048-1141dc4b750b tempest-VolumesGetTest-1424992239 None] Acquiring lock "cinder-6fad360d-b448-4556-9a71-a606c7b7c489-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1ab96961-c572-4726-b048-1141dc4b750b tempest-VolumesGetTest-1424992239 None] Lock "cinder-6fad360d-b448-4556-9a71-a606c7b7c489-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1ab96961-c572-4726-b048-1141dc4b750b tempest-VolumesGetTest-1424992239 None] Acquiring lock "cinder-quobyte-6fad360d-b448-4556-9a71-a606c7b7c489" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1ab96961-c572-4726-b048-1141dc4b750b tempest-VolumesGetTest-1424992239 None] Lock "cinder-quobyte-6fad360d-b448-4556-9a71-a606c7b7c489" acquired by "delete_volume" :: waited 0.055s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:34 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c394081-8f34-45c9-85bb-205b28fe1f7c]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1ab96961-c572-4726-b048-1141dc4b750b tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6fad360d-b448-4556-9a71-a606c7b7c489 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:35 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6fad360d-b448-4556-9a71-a606c7b7c489 Sep 07 13:51:35 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:35 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_5yq_i1c4devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104" returned: 0 in 2.954s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:35 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_5yq_i1c4devstack@QuobyteHD, size 112.00 MB, duration 2.96 sec, destination /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104 {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:51:35 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Converted 112.00 MB image at 37.90 MB/s Sep 07 13:51:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:35 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1ab96961-c572-4726-b048-1141dc4b750b tempest-VolumesGetTest-1424992239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6fad360d-b448-4556-9a71-a606c7b7c489" returned: 0 in 0.666s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1ab96961-c572-4726-b048-1141dc4b750b tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6fad360d-b448-4556-9a71-a606c7b7c489 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:35 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104 1G Sep 07 13:51:35 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:35 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6fad360d-b448-4556-9a71-a606c7b7c489 Sep 07 13:51:35 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:35 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1ab96961-c572-4726-b048-1141dc4b750b tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6fad360d-b448-4556-9a71-a606c7b7c489" returned: 0 in 0.336s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:35 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1ab96961-c572-4726-b048-1141dc4b750b tempest-VolumesGetTest-1424992239 None] Lock "cinder-quobyte-6fad360d-b448-4556-9a71-a606c7b7c489" released by "delete_volume" :: held 1.067s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:36 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-1ab96961-c572-4726-b048-1141dc4b750b tempest-VolumesGetTest-1424992239 None] Created reservations ['5aa058da-b1ee-4f46-9e58-bca9d76ebeb7', '69708279-3794-418e-9a63-bffb87b25c66', 'e00c57e5-3c4a-4d3f-9730-4c41769e6061', 'a1b39264-1992-42f9-b5ef-4c6d97c894a9'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:51:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1ab96961-c572-4726-b048-1141dc4b750b tempest-VolumesGetTest-1424992239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1ab96961-c572-4726-b048-1141dc4b750b tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1ab96961-c572-4726-b048-1141dc4b750b tempest-VolumesGetTest-1424992239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:36 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1ab96961-c572-4726-b048-1141dc4b750b tempest-VolumesGetTest-1424992239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1ab96961-c572-4726-b048-1141dc4b750b tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1ab96961-c572-4726-b048-1141dc4b750b tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104 1G" returned: 0 in 0.547s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:36 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Downloaded image bdbd1541-2076-47bf-b26a-15662727e644 ((None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}])) to volume 06640ff1-4859-4902-975f-3942e2680104 successfully. {{(pid=87571) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 13:51:36 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Temporary image bdbd1541-2076-47bf-b26a-15662727e644 for user 5e2f684320d44acda48fd77029a40557 is deleted. {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 13:51:36 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Marking volume 06640ff1-4859-4902-975f-3942e2680104 as bootable. {{(pid=87571) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 13:51:36 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:51:36 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:36 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Copying metadata from image bdbd1541-2076-47bf-b26a-15662727e644 to 06640ff1-4859-4902-975f-3942e2680104. {{(pid=87571) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 13:51:36 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Creating volume glance metadata for volume 06640ff1-4859-4902-975f-3942e2680104 backed by image bdbd1541-2076-47bf-b26a-15662727e644 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87571) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 13:51:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4795f4-79b9-46c1-ba5e-887d5afd86be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06640ff1-4859-4902-975f-3942e2680104', 'volume_size': 1, 'image_id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d9d2114dd14b01a04867c896fdabaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'created_at': datetime.datetime(2026, 9, 7, 11, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdbd1541-2076-47bf-b26a-15662727e644/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5e2a57-a2f9-4a6a-814e-a2dbbff3e4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:36 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Volume volume-06640ff1-4859-4902-975f-3942e2680104 (06640ff1-4859-4902-975f-3942e2680104): created successfully Sep 07 13:51:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5e2a57-a2f9-4a6a-814e-a2dbbff3e4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Flow 'volume_create_manager' (237a0e4a-5598-4ba0-a88d-7a90b843b3ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:36 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-45c512cc-272c-492d-8d05-1fb5d0031249 tempest-VolumesExtendTest-767164216 None] Created volume successfully. Sep 07 13:51:36 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1ab96961-c572-4726-b048-1141dc4b750b tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.493s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:36 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-1ab96961-c572-4726-b048-1141dc4b750b tempest-VolumesGetTest-1424992239 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:51:36 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-1ab96961-c572-4726-b048-1141dc4b750b tempest-VolumesGetTest-1424992239 None] Deleted volume successfully. Sep 07 13:51:36 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1ab96961-c572-4726-b048-1141dc4b750b tempest-VolumesGetTest-1424992239 None] Lock "cinder-6fad360d-b448-4556-9a71-a606c7b7c489-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:36 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_nbeeliikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-664cac84-7c2e-4092-a58f-4219c6065d08" returned: 0 in 2.971s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:36 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_nbeeliikdevstack@QuobyteHD, size 112.00 MB, duration 2.97 sec, destination /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-664cac84-7c2e-4092-a58f-4219c6065d08 {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:51:36 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Converted 112.00 MB image at 37.68 MB/s Sep 07 13:51:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-664cac84-7c2e-4092-a58f-4219c6065d08 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:36 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-664cac84-7c2e-4092-a58f-4219c6065d08 1G Sep 07 13:51:36 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:37 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-664cac84-7c2e-4092-a58f-4219c6065d08 1G" returned: 0 in 0.392s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Downloaded image bdbd1541-2076-47bf-b26a-15662727e644 ((None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}])) to volume 664cac84-7c2e-4092-a58f-4219c6065d08 successfully. {{(pid=87571) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Temporary image bdbd1541-2076-47bf-b26a-15662727e644 for user c647a47e110b47e187bab37a50f1c203 is deleted. {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Marking volume 664cac84-7c2e-4092-a58f-4219c6065d08 as bootable. {{(pid=87571) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Copying metadata from image bdbd1541-2076-47bf-b26a-15662727e644 to 664cac84-7c2e-4092-a58f-4219c6065d08. {{(pid=87571) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Creating volume glance metadata for volume 664cac84-7c2e-4092-a58f-4219c6065d08 backed by image bdbd1541-2076-47bf-b26a-15662727e644 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87571) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7be288c8-b4f9-40d6-9dd4-f046993ec79e tempest-VolumesGetTest-1424992239 None] Acquiring lock "cinder-c32e6b19-9dbd-4df2-bcbc-2ec035426be6-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7be288c8-b4f9-40d6-9dd4-f046993ec79e tempest-VolumesGetTest-1424992239 None] Lock "cinder-c32e6b19-9dbd-4df2-bcbc-2ec035426be6-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c78b993a-d93a-4256-afbd-33518e999472 tempest-VolumesExtendTest-767164216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c78b993a-d93a-4256-afbd-33518e999472 tempest-VolumesExtendTest-767164216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9ea299-b231-40e8-8873-07fec486e3ee]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c78b993a-d93a-4256-afbd-33518e999472 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7be288c8-b4f9-40d6-9dd4-f046993ec79e tempest-VolumesGetTest-1424992239 None] Acquiring lock "cinder-quobyte-c32e6b19-9dbd-4df2-bcbc-2ec035426be6" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76aaf3ad-a18b-417e-a537-333cb8bde02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-664cac84-7c2e-4092-a58f-4219c6065d08', 'volume_size': 1, 'image_id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d9d2114dd14b01a04867c896fdabaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'created_at': datetime.datetime(2026, 9, 7, 11, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdbd1541-2076-47bf-b26a-15662727e644/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c9aac1-6cc9-45f1-b5aa-be69d61f30e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:37 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Volume volume-664cac84-7c2e-4092-a58f-4219c6065d08 (664cac84-7c2e-4092-a58f-4219c6065d08): created successfully Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c9aac1-6cc9-45f1-b5aa-be69d61f30e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Flow 'volume_create_manager' (6a661a2c-2f92-49d3-8957-f85c90823a84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7be288c8-b4f9-40d6-9dd4-f046993ec79e tempest-VolumesGetTest-1424992239 None] Lock "cinder-quobyte-c32e6b19-9dbd-4df2-bcbc-2ec035426be6" acquired by "delete_volume" :: waited 0.058s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fdbcf0-86ad-4ed0-8f82-a711bf8595b2]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7be288c8-b4f9-40d6-9dd4-f046993ec79e tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c32e6b19-9dbd-4df2-bcbc-2ec035426be6 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:37 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-ce8958d5-395c-4c42-a56a-ea565671a9b4 tempest-TestShelveInstance-1626297668 None] Created volume successfully. Sep 07 13:51:37 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104 Sep 07 13:51:37 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:37 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c32e6b19-9dbd-4df2-bcbc-2ec035426be6 Sep 07 13:51:37 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:37 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c78b993a-d93a-4256-afbd-33518e999472 tempest-VolumesExtendTest-767164216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104" returned: 0 in 0.405s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c78b993a-d93a-4256-afbd-33518e999472 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104 2G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:37 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7be288c8-b4f9-40d6-9dd4-f046993ec79e tempest-VolumesGetTest-1424992239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c32e6b19-9dbd-4df2-bcbc-2ec035426be6" returned: 0 in 0.387s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7be288c8-b4f9-40d6-9dd4-f046993ec79e tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c32e6b19-9dbd-4df2-bcbc-2ec035426be6 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c78b993a-d93a-4256-afbd-33518e999472 tempest-VolumesExtendTest-767164216 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104 2G" returned: 0 in 0.100s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c78b993a-d93a-4256-afbd-33518e999472 tempest-VolumesExtendTest-767164216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.540s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:37 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c32e6b19-9dbd-4df2-bcbc-2ec035426be6 Sep 07 13:51:37 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:37 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c78b993a-d93a-4256-afbd-33518e999472 tempest-VolumesExtendTest-767164216 None] Extend volume completed successfully. Sep 07 13:51:38 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7be288c8-b4f9-40d6-9dd4-f046993ec79e tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c32e6b19-9dbd-4df2-bcbc-2ec035426be6" returned: 0 in 0.288s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7be288c8-b4f9-40d6-9dd4-f046993ec79e tempest-VolumesGetTest-1424992239 None] Lock "cinder-quobyte-c32e6b19-9dbd-4df2-bcbc-2ec035426be6" released by "delete_volume" :: held 0.730s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:38 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-7be288c8-b4f9-40d6-9dd4-f046993ec79e tempest-VolumesGetTest-1424992239 None] Created reservations ['ba025c0b-0361-4729-a813-b1aed39b66f9', '13d1c337-945d-4176-987f-c952a7a4e336', '0433325c-3902-4f75-bee9-09f984576e63', 'b4855dc0-4e00-4ee7-9b5b-3f4571524413'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:51:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7be288c8-b4f9-40d6-9dd4-f046993ec79e tempest-VolumesGetTest-1424992239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7be288c8-b4f9-40d6-9dd4-f046993ec79e tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7be288c8-b4f9-40d6-9dd4-f046993ec79e tempest-VolumesGetTest-1424992239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7be288c8-b4f9-40d6-9dd4-f046993ec79e tempest-VolumesGetTest-1424992239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7be288c8-b4f9-40d6-9dd4-f046993ec79e tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7be288c8-b4f9-40d6-9dd4-f046993ec79e tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:38 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:51:38 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ba22fed2-5ae4-40ee-bcdd-9b5580a89d3a tempest-VolumesGetTest-1424992239 None] Acquiring lock "cinder-b94031e4-acd1-4be9-9634-7f7d702e772d-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ba22fed2-5ae4-40ee-bcdd-9b5580a89d3a tempest-VolumesGetTest-1424992239 None] Lock "cinder-b94031e4-acd1-4be9-9634-7f7d702e772d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ba22fed2-5ae4-40ee-bcdd-9b5580a89d3a tempest-VolumesGetTest-1424992239 None] Acquiring lock "cinder-quobyte-b94031e4-acd1-4be9-9634-7f7d702e772d" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ba22fed2-5ae4-40ee-bcdd-9b5580a89d3a tempest-VolumesGetTest-1424992239 None] Lock "cinder-quobyte-b94031e4-acd1-4be9-9634-7f7d702e772d" acquired by "delete_volume" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:38 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7be288c8-b4f9-40d6-9dd4-f046993ec79e tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.408s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:38 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-7be288c8-b4f9-40d6-9dd4-f046993ec79e tempest-VolumesGetTest-1424992239 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:51:38 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-7be288c8-b4f9-40d6-9dd4-f046993ec79e tempest-VolumesGetTest-1424992239 None] Deleted volume successfully. Sep 07 13:51:38 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed0e5f6-5f23-4eed-bebc-52f38088e1e5]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ba22fed2-5ae4-40ee-bcdd-9b5580a89d3a tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7be288c8-b4f9-40d6-9dd4-f046993ec79e tempest-VolumesGetTest-1424992239 None] Lock "cinder-c32e6b19-9dbd-4df2-bcbc-2ec035426be6-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:38 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d Sep 07 13:51:38 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-146ee863-51cd-4259-a1c1-0a2fc271fd74 tempest-VolumesExtendTest-767164216 None] Acquiring lock "cinder-06640ff1-4859-4902-975f-3942e2680104-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-146ee863-51cd-4259-a1c1-0a2fc271fd74 tempest-VolumesExtendTest-767164216 None] Lock "cinder-06640ff1-4859-4902-975f-3942e2680104-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-146ee863-51cd-4259-a1c1-0a2fc271fd74 tempest-VolumesExtendTest-767164216 None] Acquiring lock "cinder-quobyte-06640ff1-4859-4902-975f-3942e2680104" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-146ee863-51cd-4259-a1c1-0a2fc271fd74 tempest-VolumesExtendTest-767164216 None] Lock "cinder-quobyte-06640ff1-4859-4902-975f-3942e2680104" acquired by "delete_volume" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:39 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa445008-139e-4f82-9a2f-3090c1f208a6]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-146ee863-51cd-4259-a1c1-0a2fc271fd74 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:39 devstack sudo[97195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104 Sep 07 13:51:39 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:39 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ba22fed2-5ae4-40ee-bcdd-9b5580a89d3a tempest-VolumesGetTest-1424992239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d" returned: 0 in 0.565s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ba22fed2-5ae4-40ee-bcdd-9b5580a89d3a tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:39 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d Sep 07 13:51:39 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:39 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-146ee863-51cd-4259-a1c1-0a2fc271fd74 tempest-VolumesExtendTest-767164216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104" returned: 0 in 0.462s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-146ee863-51cd-4259-a1c1-0a2fc271fd74 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:39 devstack sudo[97209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104 Sep 07 13:51:39 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:39 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ba22fed2-5ae4-40ee-bcdd-9b5580a89d3a tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b94031e4-acd1-4be9-9634-7f7d702e772d" returned: 0 in 0.374s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ba22fed2-5ae4-40ee-bcdd-9b5580a89d3a tempest-VolumesGetTest-1424992239 None] Lock "cinder-quobyte-b94031e4-acd1-4be9-9634-7f7d702e772d" released by "delete_volume" :: held 1.045s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:39 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-ba22fed2-5ae4-40ee-bcdd-9b5580a89d3a tempest-VolumesGetTest-1424992239 None] Created reservations ['ef523060-e4df-49d2-8118-9a04779b44cf', '49c54ce8-b5c6-4299-b5fd-d35c0997035f', '6a2a0621-2e95-4918-8f81-f1f5944a95ba', '4b0ef5dc-e8f4-4bf0-b995-ef479c263223'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:51:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ba22fed2-5ae4-40ee-bcdd-9b5580a89d3a tempest-VolumesGetTest-1424992239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ba22fed2-5ae4-40ee-bcdd-9b5580a89d3a tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ba22fed2-5ae4-40ee-bcdd-9b5580a89d3a tempest-VolumesGetTest-1424992239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:39 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ba22fed2-5ae4-40ee-bcdd-9b5580a89d3a tempest-VolumesGetTest-1424992239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ba22fed2-5ae4-40ee-bcdd-9b5580a89d3a tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ba22fed2-5ae4-40ee-bcdd-9b5580a89d3a tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-146ee863-51cd-4259-a1c1-0a2fc271fd74 tempest-VolumesExtendTest-767164216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-06640ff1-4859-4902-975f-3942e2680104" returned: 0 in 0.313s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:39 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:51:39 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-146ee863-51cd-4259-a1c1-0a2fc271fd74 tempest-VolumesExtendTest-767164216 None] Lock "cinder-quobyte-06640ff1-4859-4902-975f-3942e2680104" released by "delete_volume" :: held 0.853s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:40 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-146ee863-51cd-4259-a1c1-0a2fc271fd74 tempest-VolumesExtendTest-767164216 None] Created reservations ['49cac278-e07d-404d-8e38-ec52eb8f495f', '0f16a630-f8ab-4915-82b9-bd9b78179071', 'f109c917-a94d-4ada-b919-7c61da47203a', 'cdaf3e0d-1620-48c3-b461-8b514b60311d'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:51:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-146ee863-51cd-4259-a1c1-0a2fc271fd74 tempest-VolumesExtendTest-767164216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-146ee863-51cd-4259-a1c1-0a2fc271fd74 tempest-VolumesExtendTest-767164216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:40 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-146ee863-51cd-4259-a1c1-0a2fc271fd74 tempest-VolumesExtendTest-767164216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:40 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-146ee863-51cd-4259-a1c1-0a2fc271fd74 tempest-VolumesExtendTest-767164216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-146ee863-51cd-4259-a1c1-0a2fc271fd74 tempest-VolumesExtendTest-767164216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-146ee863-51cd-4259-a1c1-0a2fc271fd74 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:40 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:51:40 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:40 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ba22fed2-5ae4-40ee-bcdd-9b5580a89d3a tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.379s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:40 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-ba22fed2-5ae4-40ee-bcdd-9b5580a89d3a tempest-VolumesGetTest-1424992239 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:51:40 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-ba22fed2-5ae4-40ee-bcdd-9b5580a89d3a tempest-VolumesGetTest-1424992239 None] Deleted volume successfully. Sep 07 13:51:40 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ba22fed2-5ae4-40ee-bcdd-9b5580a89d3a tempest-VolumesGetTest-1424992239 None] Lock "cinder-b94031e4-acd1-4be9-9634-7f7d702e772d-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:40 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-146ee863-51cd-4259-a1c1-0a2fc271fd74 tempest-VolumesExtendTest-767164216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.281s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:40 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-146ee863-51cd-4259-a1c1-0a2fc271fd74 tempest-VolumesExtendTest-767164216 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:51:40 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-146ee863-51cd-4259-a1c1-0a2fc271fd74 tempest-VolumesExtendTest-767164216 None] Deleted volume successfully. Sep 07 13:51:40 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-146ee863-51cd-4259-a1c1-0a2fc271fd74 tempest-VolumesExtendTest-767164216 None] Lock "cinder-06640ff1-4859-4902-975f-3942e2680104-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-b2f22f2e-399a-4e30-9c4c-2c13175f228c req-ab802336-79a5-4f36-a1b6-27226a423c2b tempest-TestShelveInstance-1626297668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-b2f22f2e-399a-4e30-9c4c-2c13175f228c req-ab802336-79a5-4f36-a1b6-27226a423c2b tempest-TestShelveInstance-1626297668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-b2f22f2e-399a-4e30-9c4c-2c13175f228c req-ab802336-79a5-4f36-a1b6-27226a423c2b tempest-TestShelveInstance-1626297668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-b2f22f2e-399a-4e30-9c4c-2c13175f228c req-ab802336-79a5-4f36-a1b6-27226a423c2b tempest-TestShelveInstance-1626297668 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285', 'name': 'volume-664cac84-7c2e-4092-a58f-4219c6065d08', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a344fa6d-3256-4075-8652-8302c529d01a', 'enforce_multipath': True} {{(pid=87571) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Flow 'volume_create_manager' (c8061859-10c3-4682-aebc-cfd567b1c1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dfb26be-28b0-469f-9a7b-8ec21242e6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dfb26be-28b0-469f-9a7b-8ec21242e6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1168950144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a285816-c173-4f1f-bda8-5d988ee5d2b2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ad578935552d4d118f97a8607eba93f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:42Z,use_quota=True,user_id='5e4cd642ccf14bc3b0fdf3ad26e0e592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13df1fca-0191-4a7f-a995-c24b0b005839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13df1fca-0191-4a7f-a995-c24b0b005839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669eaed6-889a-4242-a456-9a503b0a6964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.image.glance [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Creating Keystone auth plugin from conf {{(pid=87571) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 13:51:42 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-b2f22f2e-399a-4e30-9c4c-2c13175f228c req-ab802336-79a5-4f36-a1b6-27226a423c2b tempest-TestShelveInstance-1626297668 None] attachment_update completed successfully. Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Flow 'volume_create_manager' (eebf0ddc-d135-41df-ac38-706f4c0af43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be56ba7f-1b9a-42a9-b315-b36d1477de8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be56ba7f-1b9a-42a9-b315-b36d1477de8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1768682289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=247644e5-8cf3-4393-9433-e5650bb42a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2a9ce076024a3aa391aafaaca43888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:42Z,use_quota=True,user_id='5e2f684320d44acda48fd77029a40557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1257b8d7-7362-4cde-9c32-d0ababbf233a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1257b8d7-7362-4cde-9c32-d0ababbf233a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5217907-5451-4e03-91a0-3fdc27c78610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5217907-5451-4e03-91a0-3fdc27c78610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '247644e5-8cf3-4393-9433-e5650bb42a0b', 'volume_name': 'volume-247644e5-8cf3-4393-9433-e5650bb42a0b', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95d4271-a307-47bc-ab60-84b0cf1a975c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95d4271-a307-47bc-ab60-84b0cf1a975c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b15364-8c8b-49e3-824b-ff31835065fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:42 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Volume 247644e5-8cf3-4393-9433-e5650bb42a0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-247644e5-8cf3-4393-9433-e5650bb42a0b', 'volume_size': 1} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1768682289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=247644e5-8cf3-4393-9433-e5650bb42a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2a9ce076024a3aa391aafaaca43888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:42Z,use_quota=True,user_id='5e2f684320d44acda48fd77029a40557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Creating volume 247644e5-8cf3-4393-9433-e5650bb42a0b {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:51:42 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:42 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b 1073741824 Sep 07 13:51:42 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669eaed6-889a-4242-a456-9a503b0a6964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9a285816-c173-4f1f-bda8-5d988ee5d2b2', 'volume_name': 'volume-9a285816-c173-4f1f-bda8-5d988ee5d2b2', 'volume_size': 1, 'image_id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d9d2114dd14b01a04867c896fdabaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'created_at': datetime.datetime(2026, 9, 7, 11, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdbd1541-2076-47bf-b26a-15662727e644/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638ce452-fa41-4cd1-b37c-474fa10a714e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638ce452-fa41-4cd1-b37c-474fa10a714e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4141680-f95d-431d-99ce-1431afd46e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:42 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Volume 9a285816-c173-4f1f-bda8-5d988ee5d2b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9a285816-c173-4f1f-bda8-5d988ee5d2b2', 'volume_size': 1, 'image_id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d9d2114dd14b01a04867c896fdabaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'created_at': datetime.datetime(2026, 9, 7, 11, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdbd1541-2076-47bf-b26a-15662727e644/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 13:51:42 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Trying to clone 9a285816-c173-4f1f-bda8-5d988ee5d2b2 from image bdbd1541-2076-47bf-b26a-15662727e644 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}]). {{(pid=87571) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1099}} Sep 07 13:51:43 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bhkap2opdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 13:51:43 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Image download 20.69 MB at 20.69 MB/s Sep 07 13:51:43 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf31b70-12df-4e4f-8aba-8bf44322c459]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bhkap2opdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:43 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b 1073741824" returned: 0 in 0.875s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:43 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bhkap2opdevstack@QuobyteHD Sep 07 13:51:43 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:43 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b Sep 07 13:51:43 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:43 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bhkap2opdevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:43 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Temporary image bdbd1541-2076-47bf-b26a-15662727e644 is fetched for user 5e4cd642ccf14bc3b0fdf3ad26e0e592. {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 13:51:43 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b" returned: 0 in 0.331s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:51:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:43 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b15364-8c8b-49e3-824b-ff31835065fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-247644e5-8cf3-4393-9433-e5650bb42a0b', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:43 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (639e6727-5b99-48c2-a48c-7b1eb74427a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:43 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Volume volume-247644e5-8cf3-4393-9433-e5650bb42a0b (247644e5-8cf3-4393-9433-e5650bb42a0b): created successfully Sep 07 13:51:43 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (639e6727-5b99-48c2-a48c-7b1eb74427a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:43 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Flow 'volume_create_manager' (eebf0ddc-d135-41df-ac38-706f4c0af43d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:43 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ac1d0b-12c2-4e5e-bb31-99ba314a5e23]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bhkap2opdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:44 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-b41286f1-4cdb-400e-b5a8-d0426b4346ca tempest-VolumesExtendTest-767164216 None] Created volume successfully. Sep 07 13:51:44 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bhkap2opdevstack@QuobyteHD Sep 07 13:51:44 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:44 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bhkap2opdevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1168950144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a285816-c173-4f1f-bda8-5d988ee5d2b2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ad578935552d4d118f97a8607eba93f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:42Z,use_quota=True,user_id='5e4cd642ccf14bc3b0fdf3ad26e0e592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:51:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Creating volume 9a285816-c173-4f1f-bda8-5d988ee5d2b2 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:51:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:51:44 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:51:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9a285816-c173-4f1f-bda8-5d988ee5d2b2 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:44 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9a285816-c173-4f1f-bda8-5d988ee5d2b2 1073741824 Sep 07 13:51:44 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-184fb456-2079-43e9-b959-d8e679346ad2 tempest-VolumesExtendTest-767164216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:45 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9a285816-c173-4f1f-bda8-5d988ee5d2b2 1073741824" returned: 0 in 0.647s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9a285816-c173-4f1f-bda8-5d988ee5d2b2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:45 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9a285816-c173-4f1f-bda8-5d988ee5d2b2 Sep 07 13:51:45 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:45 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9a285816-c173-4f1f-bda8-5d988ee5d2b2" returned: 0 in 0.536s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:45 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:51:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-184fb456-2079-43e9-b959-d8e679346ad2 tempest-VolumesExtendTest-767164216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.874s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:45 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-184fb456-2079-43e9-b959-d8e679346ad2 tempest-VolumesExtendTest-767164216 None] Creating offline snapshot dd52dbda-334d-4360-88dc-011ed4e98e16 of volume 247644e5-8cf3-4393-9433-e5650bb42a0b {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:51:45 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Attempting download of bdbd1541-2076-47bf-b26a-15662727e644 ((None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}])) to volume 9a285816-c173-4f1f-bda8-5d988ee5d2b2. {{(pid=87571) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 13:51:45 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[92043d2e-5eee-4ca8-995c-2fc3c478cd9a]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-184fb456-2079-43e9-b959-d8e679346ad2 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:46 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[011241fc-83c7-4093-be2f-2ad1cd7d18ea]: (4, 'raw') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_q11uulq5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:46 devstack sudo[97342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b Sep 07 13:51:46 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:46 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_q11uulq5 Sep 07 13:51:46 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:46 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-184fb456-2079-43e9-b959-d8e679346ad2 tempest-VolumesExtendTest-767164216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b" returned: 0 in 0.755s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-184fb456-2079-43e9-b959-d8e679346ad2 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.dd52dbda-334d-4360-88dc-011ed4e98e16 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:46 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_q11uulq5" returned: 0 in 0.668s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:46 devstack sudo[97697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.dd52dbda-334d-4360-88dc-011ed4e98e16 1G Sep 07 13:51:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_q11uulq5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:46 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:47 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_q11uulq5 Sep 07 13:51:47 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:47 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_q11uulq5" returned: 1 in 0.639s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd1541-2076-47bf-b26a-15662727e644_q11uulq5' failed. Not Retrying. {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 13:51:47 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d995691-ebd9-4e2a-a05d-2721ef9cb8c1]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bhkap2opdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:47 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-184fb456-2079-43e9-b959-d8e679346ad2 tempest-VolumesExtendTest-767164216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.dd52dbda-334d-4360-88dc-011ed4e98e16 1G" returned: 0 in 0.850s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-184fb456-2079-43e9-b959-d8e679346ad2 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-247644e5-8cf3-4393-9433-e5650bb42a0b -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.dd52dbda-334d-4360-88dc-011ed4e98e16 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:47 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-247644e5-8cf3-4393-9433-e5650bb42a0b -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.dd52dbda-334d-4360-88dc-011ed4e98e16 Sep 07 13:51:47 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:47 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bhkap2opdevstack@QuobyteHD Sep 07 13:51:47 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:47 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bhkap2opdevstack@QuobyteHD" returned: 0 in 0.536s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:47 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] bdbd1541-2076-47bf-b26a-15662727e644 was qcow2, converting to qcow2 {{(pid=87571) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 13:51:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bhkap2opdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9a285816-c173-4f1f-bda8-5d988ee5d2b2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:47 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-184fb456-2079-43e9-b959-d8e679346ad2 tempest-VolumesExtendTest-767164216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-247644e5-8cf3-4393-9433-e5650bb42a0b -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.dd52dbda-334d-4360-88dc-011ed4e98e16" returned: 0 in 0.392s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:47 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-184fb456-2079-43e9-b959-d8e679346ad2 tempest-VolumesExtendTest-767164216 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.dd52dbda-334d-4360-88dc-011ed4e98e16 is being set with open permissions: ugo+rw Sep 07 13:51:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-184fb456-2079-43e9-b959-d8e679346ad2 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.dd52dbda-334d-4360-88dc-011ed4e98e16 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:47 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bhkap2opdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9a285816-c173-4f1f-bda8-5d988ee5d2b2 Sep 07 13:51:47 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:47 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.dd52dbda-334d-4360-88dc-011ed4e98e16 Sep 07 13:51:47 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:48 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-184fb456-2079-43e9-b959-d8e679346ad2 tempest-VolumesExtendTest-767164216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.dd52dbda-334d-4360-88dc-011ed4e98e16" returned: 0 in 0.547s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-184fb456-2079-43e9-b959-d8e679346ad2 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:48 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.info Sep 07 13:51:48 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:49 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-184fb456-2079-43e9-b959-d8e679346ad2 tempest-VolumesExtendTest-767164216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.info" returned: 0 in 0.511s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:49 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-184fb456-2079-43e9-b959-d8e679346ad2 tempest-VolumesExtendTest-767164216 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.info is being set with open permissions: ugo+rw Sep 07 13:51:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-184fb456-2079-43e9-b959-d8e679346ad2 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:49 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.info Sep 07 13:51:49 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:49 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-184fb456-2079-43e9-b959-d8e679346ad2 tempest-VolumesExtendTest-767164216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.info" returned: 0 in 0.268s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-184fb456-2079-43e9-b959-d8e679346ad2 tempest-VolumesExtendTest-767164216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.587s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:49 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-184fb456-2079-43e9-b959-d8e679346ad2 tempest-VolumesExtendTest-767164216 None] Create snapshot completed successfully Sep 07 13:51:50 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bhkap2opdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9a285816-c173-4f1f-bda8-5d988ee5d2b2" returned: 0 in 2.534s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:50 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bdbd1541-2076-47bf-b26a-15662727e644_bhkap2opdevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9a285816-c173-4f1f-bda8-5d988ee5d2b2 {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:51:50 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Converted 112.00 MB image at 44.18 MB/s Sep 07 13:51:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9a285816-c173-4f1f-bda8-5d988ee5d2b2 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-09ca0f60-2b94-4ea1-9a53-cd749d4052fc tempest-VolumesExtendTest-767164216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-09ca0f60-2b94-4ea1-9a53-cd749d4052fc tempest-VolumesExtendTest-767164216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:50 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9a285816-c173-4f1f-bda8-5d988ee5d2b2 1G Sep 07 13:51:50 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:50 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab6ed7a-ac47-4b00-be16-581d5a5cc78a]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-09ca0f60-2b94-4ea1-9a53-cd749d4052fc tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:50 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b Sep 07 13:51:50 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:51 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:51 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-09ca0f60-2b94-4ea1-9a53-cd749d4052fc tempest-VolumesExtendTest-767164216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b" returned: 0 in 0.577s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-09ca0f60-2b94-4ea1-9a53-cd749d4052fc tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.dd52dbda-334d-4360-88dc-011ed4e98e16 2G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9a285816-c173-4f1f-bda8-5d988ee5d2b2 1G" returned: 0 in 0.687s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Downloaded image bdbd1541-2076-47bf-b26a-15662727e644 ((None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}])) to volume 9a285816-c173-4f1f-bda8-5d988ee5d2b2 successfully. {{(pid=87571) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Temporary image bdbd1541-2076-47bf-b26a-15662727e644 for user 5e4cd642ccf14bc3b0fdf3ad26e0e592 is deleted. {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Marking volume 9a285816-c173-4f1f-bda8-5d988ee5d2b2 as bootable. {{(pid=87571) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Copying metadata from image bdbd1541-2076-47bf-b26a-15662727e644 to 9a285816-c173-4f1f-bda8-5d988ee5d2b2. {{(pid=87571) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Creating volume glance metadata for volume 9a285816-c173-4f1f-bda8-5d988ee5d2b2 backed by image bdbd1541-2076-47bf-b26a-15662727e644 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87571) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4141680-f95d-431d-99ce-1431afd46e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a285816-c173-4f1f-bda8-5d988ee5d2b2', 'volume_size': 1, 'image_id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd1541-2076-47bf-b26a-15662727e644', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d9d2114dd14b01a04867c896fdabaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bdbd1541-2076-47bf-b26a-15662727e644', 'created_at': datetime.datetime(2026, 9, 7, 11, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 38, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdbd1541-2076-47bf-b26a-15662727e644/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc10889-8540-418e-9c5c-236ca4ff09e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-09ca0f60-2b94-4ea1-9a53-cd749d4052fc tempest-VolumesExtendTest-767164216 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.dd52dbda-334d-4360-88dc-011ed4e98e16 2G" returned: 0 in 0.236s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-09ca0f60-2b94-4ea1-9a53-cd749d4052fc tempest-VolumesExtendTest-767164216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.870s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:51 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Volume volume-9a285816-c173-4f1f-bda8-5d988ee5d2b2 (9a285816-c173-4f1f-bda8-5d988ee5d2b2): created successfully Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc10889-8540-418e-9c5c-236ca4ff09e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Flow 'volume_create_manager' (c8061859-10c3-4682-aebc-cfd567b1c1ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:51 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-efc7bb93-3dbb-4950-b8e0-e41ebb01dc7a tempest-VolumesGetTest-1424992239 None] Created volume successfully. Sep 07 13:51:51 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-09ca0f60-2b94-4ea1-9a53-cd749d4052fc tempest-VolumesExtendTest-767164216 None] Extend volume completed successfully. Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cd0390d0-d479-4729-9a8d-dc0fdee53dd2 tempest-VolumesExtendTest-767164216 None] Acquiring lock "cinder-dd52dbda-334d-4360-88dc-011ed4e98e16-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cd0390d0-d479-4729-9a8d-dc0fdee53dd2 tempest-VolumesExtendTest-767164216 None] Lock "cinder-dd52dbda-334d-4360-88dc-011ed4e98e16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cd0390d0-d479-4729-9a8d-dc0fdee53dd2 tempest-VolumesExtendTest-767164216 None] Acquiring lock "cinder-quobyte-247644e5-8cf3-4393-9433-e5650bb42a0b" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cd0390d0-d479-4729-9a8d-dc0fdee53dd2 tempest-VolumesExtendTest-767164216 None] Lock "cinder-quobyte-247644e5-8cf3-4393-9433-e5650bb42a0b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cd0390d0-d479-4729-9a8d-dc0fdee53dd2 tempest-VolumesExtendTest-767164216 None] Acquiring lock "cinder-quobyte-dd52dbda-334d-4360-88dc-011ed4e98e16" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cd0390d0-d479-4729-9a8d-dc0fdee53dd2 tempest-VolumesExtendTest-767164216 None] Lock "cinder-quobyte-dd52dbda-334d-4360-88dc-011ed4e98e16" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-cd0390d0-d479-4729-9a8d-dc0fdee53dd2 tempest-VolumesExtendTest-767164216 None] Deleting offline snapshot dd52dbda-334d-4360-88dc-011ed4e98e16 of volume 247644e5-8cf3-4393-9433-e5650bb42a0b {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-cd0390d0-d479-4729-9a8d-dc0fdee53dd2 tempest-VolumesExtendTest-767164216 None] snapshot_file for this snap is: volume-247644e5-8cf3-4393-9433-e5650bb42a0b.dd52dbda-334d-4360-88dc-011ed4e98e16 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c247ca6-3f7e-4673-a7fc-60a2c994e5ae]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cd0390d0-d479-4729-9a8d-dc0fdee53dd2 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.dd52dbda-334d-4360-88dc-011ed4e98e16 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:52 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.dd52dbda-334d-4360-88dc-011ed4e98e16 Sep 07 13:51:52 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:52 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cd0390d0-d479-4729-9a8d-dc0fdee53dd2 tempest-VolumesExtendTest-767164216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.dd52dbda-334d-4360-88dc-011ed4e98e16" returned: 0 in 0.613s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:52 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-cd0390d0-d479-4729-9a8d-dc0fdee53dd2 tempest-VolumesExtendTest-767164216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-247644e5-8cf3-4393-9433-e5650bb42a0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:51:52 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ed83dc-d794-4d07-aad2-ac87421bccaf]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cd0390d0-d479-4729-9a8d-dc0fdee53dd2 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:52 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b Sep 07 13:51:52 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Flow 'volume_create_manager' (3d7ad955-0e49-4162-8cd7-7bedc26e8c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230b0292-a5bf-4b3d-ba6b-9360cfd53762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230b0292-a5bf-4b3d-ba6b-9360cfd53762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-217942409',display_name='tempest-VolumesGetTest-Volume-1752381678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295dc7b4-9dda-4e9e-89b6-6fee392d88f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad578935552d4d118f97a8607eba93f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:53Z,use_quota=True,user_id='5e4cd642ccf14bc3b0fdf3ad26e0e592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5cfdffe-b102-4c91-9612-afe054853a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5cfdffe-b102-4c91-9612-afe054853a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a195ffd-757f-48ef-8cd4-62631eb50726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a195ffd-757f-48ef-8cd4-62631eb50726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '295dc7b4-9dda-4e9e-89b6-6fee392d88f9', 'volume_name': 'volume-295dc7b4-9dda-4e9e-89b6-6fee392d88f9', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b21901a-72a1-4755-a443-fe9fa6cb698d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b21901a-72a1-4755-a443-fe9fa6cb698d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb9c2c1-859e-473a-9834-130c1154e3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:53 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Volume 295dc7b4-9dda-4e9e-89b6-6fee392d88f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-295dc7b4-9dda-4e9e-89b6-6fee392d88f9', 'volume_size': 1} Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-217942409',display_name='tempest-VolumesGetTest-Volume-1752381678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295dc7b4-9dda-4e9e-89b6-6fee392d88f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad578935552d4d118f97a8607eba93f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:53Z,use_quota=True,user_id='5e4cd642ccf14bc3b0fdf3ad26e0e592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Creating volume 295dc7b4-9dda-4e9e-89b6-6fee392d88f9 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:53 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:51:53 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-295dc7b4-9dda-4e9e-89b6-6fee392d88f9 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cd0390d0-d479-4729-9a8d-dc0fdee53dd2 tempest-VolumesExtendTest-767164216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b" returned: 0 in 0.735s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cd0390d0-d479-4729-9a8d-dc0fdee53dd2 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.dd52dbda-334d-4360-88dc-011ed4e98e16 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:53 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-295dc7b4-9dda-4e9e-89b6-6fee392d88f9 1073741824 Sep 07 13:51:53 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:53 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.dd52dbda-334d-4360-88dc-011ed4e98e16 Sep 07 13:51:53 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:53 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cd0390d0-d479-4729-9a8d-dc0fdee53dd2 tempest-VolumesExtendTest-767164216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.dd52dbda-334d-4360-88dc-011ed4e98e16" returned: 0 in 0.542s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cd0390d0-d479-4729-9a8d-dc0fdee53dd2 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.dd52dbda-334d-4360-88dc-011ed4e98e16 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:53 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.dd52dbda-334d-4360-88dc-011ed4e98e16 Sep 07 13:51:53 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:53 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-295dc7b4-9dda-4e9e-89b6-6fee392d88f9 1073741824" returned: 0 in 0.641s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-295dc7b4-9dda-4e9e-89b6-6fee392d88f9 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:54 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-295dc7b4-9dda-4e9e-89b6-6fee392d88f9 Sep 07 13:51:54 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:54 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cd0390d0-d479-4729-9a8d-dc0fdee53dd2 tempest-VolumesExtendTest-767164216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b.dd52dbda-334d-4360-88dc-011ed4e98e16" returned: 0 in 0.385s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cd0390d0-d479-4729-9a8d-dc0fdee53dd2 tempest-VolumesExtendTest-767164216 None] Lock "cinder-quobyte-dd52dbda-334d-4360-88dc-011ed4e98e16" released by "_delete_snapshot" :: held 2.432s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cd0390d0-d479-4729-9a8d-dc0fdee53dd2 tempest-VolumesExtendTest-767164216 None] Lock "cinder-quobyte-247644e5-8cf3-4393-9433-e5650bb42a0b" released by "delete_snapshot" :: held 2.468s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:54 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-cd0390d0-d479-4729-9a8d-dc0fdee53dd2 tempest-VolumesExtendTest-767164216 None] Created reservations ['2639d5c7-f9fb-4cde-af3d-815a3c08d4d5', 'b48736a0-b47c-445e-b87c-b695f88f1a18', '061a2713-cf9e-4cb2-8428-61cc4917dba6', '5739c510-33ff-4dfe-9805-24d6e3ad1570'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:51:54 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-295dc7b4-9dda-4e9e-89b6-6fee392d88f9" returned: 0 in 0.398s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:54 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:51:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb9c2c1-859e-473a-9834-130c1154e3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-295dc7b4-9dda-4e9e-89b6-6fee392d88f9', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2f7a83-4eec-46c0-bac1-da552e89c55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:54 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Volume volume-295dc7b4-9dda-4e9e-89b6-6fee392d88f9 (295dc7b4-9dda-4e9e-89b6-6fee392d88f9): created successfully Sep 07 13:51:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2f7a83-4eec-46c0-bac1-da552e89c55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Flow 'volume_create_manager' (3d7ad955-0e49-4162-8cd7-7bedc26e8c75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:54 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-ef3c592d-2055-4839-87c0-641f7eeccaba tempest-VolumesGetTest-1424992239 None] Created volume successfully. Sep 07 13:51:54 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-cd0390d0-d479-4729-9a8d-dc0fdee53dd2 tempest-VolumesExtendTest-767164216 None] Delete snapshot completed successfully. Sep 07 13:51:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cd0390d0-d479-4729-9a8d-dc0fdee53dd2 tempest-VolumesExtendTest-767164216 None] Lock "cinder-dd52dbda-334d-4360-88dc-011ed4e98e16-delete_snapshot" released by "delete_snapshot" :: held 2.704s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-eace161b-d104-443c-aa91-395cd9de6591 tempest-VolumesExtendTest-767164216 None] Acquiring lock "cinder-247644e5-8cf3-4393-9433-e5650bb42a0b-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-eace161b-d104-443c-aa91-395cd9de6591 tempest-VolumesExtendTest-767164216 None] Lock "cinder-247644e5-8cf3-4393-9433-e5650bb42a0b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-eace161b-d104-443c-aa91-395cd9de6591 tempest-VolumesExtendTest-767164216 None] Acquiring lock "cinder-quobyte-247644e5-8cf3-4393-9433-e5650bb42a0b" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-eace161b-d104-443c-aa91-395cd9de6591 tempest-VolumesExtendTest-767164216 None] Lock "cinder-quobyte-247644e5-8cf3-4393-9433-e5650bb42a0b" acquired by "delete_volume" :: waited 0.024s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:55 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ce8bd8-5b15-47d6-af83-8e3e6c0839f1]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-eace161b-d104-443c-aa91-395cd9de6591 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:55 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b Sep 07 13:51:55 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ac465161-dd94-471e-90e5-a3381398615d tempest-VolumesGetTest-1424992239 None] Acquiring lock "cinder-295dc7b4-9dda-4e9e-89b6-6fee392d88f9-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ac465161-dd94-471e-90e5-a3381398615d tempest-VolumesGetTest-1424992239 None] Lock "cinder-295dc7b4-9dda-4e9e-89b6-6fee392d88f9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ac465161-dd94-471e-90e5-a3381398615d tempest-VolumesGetTest-1424992239 None] Acquiring lock "cinder-quobyte-295dc7b4-9dda-4e9e-89b6-6fee392d88f9" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ac465161-dd94-471e-90e5-a3381398615d tempest-VolumesGetTest-1424992239 None] Lock "cinder-quobyte-295dc7b4-9dda-4e9e-89b6-6fee392d88f9" acquired by "delete_volume" :: waited 0.016s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:55 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b15c6c-a6ca-4a88-9add-eb3c438801ff]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ac465161-dd94-471e-90e5-a3381398615d tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-295dc7b4-9dda-4e9e-89b6-6fee392d88f9 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:55 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-295dc7b4-9dda-4e9e-89b6-6fee392d88f9 Sep 07 13:51:55 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:55 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-eace161b-d104-443c-aa91-395cd9de6591 tempest-VolumesExtendTest-767164216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b" returned: 0 in 0.496s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-eace161b-d104-443c-aa91-395cd9de6591 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:55 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b Sep 07 13:51:55 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:56 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ac465161-dd94-471e-90e5-a3381398615d tempest-VolumesGetTest-1424992239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-295dc7b4-9dda-4e9e-89b6-6fee392d88f9" returned: 0 in 0.505s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ac465161-dd94-471e-90e5-a3381398615d tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-295dc7b4-9dda-4e9e-89b6-6fee392d88f9 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:56 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-eace161b-d104-443c-aa91-395cd9de6591 tempest-VolumesExtendTest-767164216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-247644e5-8cf3-4393-9433-e5650bb42a0b" returned: 0 in 0.331s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:56 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-295dc7b4-9dda-4e9e-89b6-6fee392d88f9 Sep 07 13:51:56 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-eace161b-d104-443c-aa91-395cd9de6591 tempest-VolumesExtendTest-767164216 None] Lock "cinder-quobyte-247644e5-8cf3-4393-9433-e5650bb42a0b" released by "delete_volume" :: held 0.910s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-eace161b-d104-443c-aa91-395cd9de6591 tempest-VolumesExtendTest-767164216 None] Created reservations ['435eb166-ae3f-4d24-b982-4891c65e5c35', '08b4fde2-bd98-4614-9abc-3a0670efc8bf', 'f29f19bc-a692-48b9-83e1-fc5a57eb06ed', '2be9704d-7730-45f7-9356-fb2211851b65'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-eace161b-d104-443c-aa91-395cd9de6591 tempest-VolumesExtendTest-767164216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-eace161b-d104-443c-aa91-395cd9de6591 tempest-VolumesExtendTest-767164216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-eace161b-d104-443c-aa91-395cd9de6591 tempest-VolumesExtendTest-767164216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-eace161b-d104-443c-aa91-395cd9de6591 tempest-VolumesExtendTest-767164216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-eace161b-d104-443c-aa91-395cd9de6591 tempest-VolumesExtendTest-767164216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-eace161b-d104-443c-aa91-395cd9de6591 tempest-VolumesExtendTest-767164216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:56 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:51:56 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:56 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ac465161-dd94-471e-90e5-a3381398615d tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-295dc7b4-9dda-4e9e-89b6-6fee392d88f9" returned: 0 in 0.323s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ac465161-dd94-471e-90e5-a3381398615d tempest-VolumesGetTest-1424992239 None] Lock "cinder-quobyte-295dc7b4-9dda-4e9e-89b6-6fee392d88f9" released by "delete_volume" :: held 0.886s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-ac465161-dd94-471e-90e5-a3381398615d tempest-VolumesGetTest-1424992239 None] Created reservations ['d190eccb-bc18-4351-9c85-5e37e2a22253', '9208536d-b48f-42c8-8942-d3919fd94d1e', 'a29fad1a-ed1b-4b8e-a5f2-7d6c94e80bf1', '9472356e-693c-4ab4-822b-16d123fc5d78'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ac465161-dd94-471e-90e5-a3381398615d tempest-VolumesGetTest-1424992239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ac465161-dd94-471e-90e5-a3381398615d tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ac465161-dd94-471e-90e5-a3381398615d tempest-VolumesGetTest-1424992239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ac465161-dd94-471e-90e5-a3381398615d tempest-VolumesGetTest-1424992239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ac465161-dd94-471e-90e5-a3381398615d tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ac465161-dd94-471e-90e5-a3381398615d tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:56 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:51:56 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:56 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-eace161b-d104-443c-aa91-395cd9de6591 tempest-VolumesExtendTest-767164216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.420s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-eace161b-d104-443c-aa91-395cd9de6591 tempest-VolumesExtendTest-767164216 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:51:56 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-eace161b-d104-443c-aa91-395cd9de6591 tempest-VolumesExtendTest-767164216 None] Deleted volume successfully. Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-eace161b-d104-443c-aa91-395cd9de6591 tempest-VolumesExtendTest-767164216 None] Lock "cinder-247644e5-8cf3-4393-9433-e5650bb42a0b-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9a93e133-52a3-47af-80c7-6998a5b1bbe9 tempest-VolumesGetTest-1424992239 None] Acquiring lock "cinder-9a285816-c173-4f1f-bda8-5d988ee5d2b2-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9a93e133-52a3-47af-80c7-6998a5b1bbe9 tempest-VolumesGetTest-1424992239 None] Lock "cinder-9a285816-c173-4f1f-bda8-5d988ee5d2b2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9a93e133-52a3-47af-80c7-6998a5b1bbe9 tempest-VolumesGetTest-1424992239 None] Acquiring lock "cinder-quobyte-9a285816-c173-4f1f-bda8-5d988ee5d2b2" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9a93e133-52a3-47af-80c7-6998a5b1bbe9 tempest-VolumesGetTest-1424992239 None] Lock "cinder-quobyte-9a285816-c173-4f1f-bda8-5d988ee5d2b2" acquired by "delete_volume" :: waited 0.030s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:57 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fa0a88-b7f6-4ed7-9adb-c584b65050bb]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9a93e133-52a3-47af-80c7-6998a5b1bbe9 tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9a285816-c173-4f1f-bda8-5d988ee5d2b2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:57 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ac465161-dd94-471e-90e5-a3381398615d tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.508s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:57 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-ac465161-dd94-471e-90e5-a3381398615d tempest-VolumesGetTest-1424992239 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:51:57 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-ac465161-dd94-471e-90e5-a3381398615d tempest-VolumesGetTest-1424992239 None] Deleted volume successfully. Sep 07 13:51:57 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9a285816-c173-4f1f-bda8-5d988ee5d2b2 Sep 07 13:51:57 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ac465161-dd94-471e-90e5-a3381398615d tempest-VolumesGetTest-1424992239 None] Lock "cinder-295dc7b4-9dda-4e9e-89b6-6fee392d88f9-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:57 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9a93e133-52a3-47af-80c7-6998a5b1bbe9 tempest-VolumesGetTest-1424992239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9a285816-c173-4f1f-bda8-5d988ee5d2b2" returned: 0 in 0.403s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9a93e133-52a3-47af-80c7-6998a5b1bbe9 tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9a285816-c173-4f1f-bda8-5d988ee5d2b2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:57 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9a285816-c173-4f1f-bda8-5d988ee5d2b2 Sep 07 13:51:57 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:57 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9a93e133-52a3-47af-80c7-6998a5b1bbe9 tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9a285816-c173-4f1f-bda8-5d988ee5d2b2" returned: 0 in 0.283s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9a93e133-52a3-47af-80c7-6998a5b1bbe9 tempest-VolumesGetTest-1424992239 None] Lock "cinder-quobyte-9a285816-c173-4f1f-bda8-5d988ee5d2b2" released by "delete_volume" :: held 0.752s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:57 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-9a93e133-52a3-47af-80c7-6998a5b1bbe9 tempest-VolumesGetTest-1424992239 None] Created reservations ['9fde4988-11e5-43b5-be1c-14d8ab099281', '912b1773-893f-4ab7-9678-fe57d39ca9e2', '57813dc0-3547-43c0-9ec7-d98862d31023', '238cabd9-1c2f-4d7c-a14d-c1b56150e04e'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:51:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9a93e133-52a3-47af-80c7-6998a5b1bbe9 tempest-VolumesGetTest-1424992239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9a93e133-52a3-47af-80c7-6998a5b1bbe9 tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9a93e133-52a3-47af-80c7-6998a5b1bbe9 tempest-VolumesGetTest-1424992239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9a93e133-52a3-47af-80c7-6998a5b1bbe9 tempest-VolumesGetTest-1424992239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9a93e133-52a3-47af-80c7-6998a5b1bbe9 tempest-VolumesGetTest-1424992239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9a93e133-52a3-47af-80c7-6998a5b1bbe9 tempest-VolumesGetTest-1424992239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:57 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:51:57 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:58 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9a93e133-52a3-47af-80c7-6998a5b1bbe9 tempest-VolumesGetTest-1424992239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.343s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:58 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-9a93e133-52a3-47af-80c7-6998a5b1bbe9 tempest-VolumesGetTest-1424992239 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:51:58 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-9a93e133-52a3-47af-80c7-6998a5b1bbe9 tempest-VolumesGetTest-1424992239 None] Deleted volume successfully. Sep 07 13:51:58 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9a93e133-52a3-47af-80c7-6998a5b1bbe9 tempest-VolumesGetTest-1424992239 None] Lock "cinder-9a285816-c173-4f1f-bda8-5d988ee5d2b2-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:03 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f0cb5904-83ee-419f-ac5c-52c2a3e0d9e5 tempest-AttachVolumeShelveTestJSON-925670451 None] Acquiring lock "cinder-ecb9f44f-7a27-4dde-9d8a-500f237b492c-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:03 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f0cb5904-83ee-419f-ac5c-52c2a3e0d9e5 tempest-AttachVolumeShelveTestJSON-925670451 None] Lock "cinder-ecb9f44f-7a27-4dde-9d8a-500f237b492c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:03 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f0cb5904-83ee-419f-ac5c-52c2a3e0d9e5 tempest-AttachVolumeShelveTestJSON-925670451 None] Acquiring lock "cinder-quobyte-ecb9f44f-7a27-4dde-9d8a-500f237b492c" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:03 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f0cb5904-83ee-419f-ac5c-52c2a3e0d9e5 tempest-AttachVolumeShelveTestJSON-925670451 None] Lock "cinder-quobyte-ecb9f44f-7a27-4dde-9d8a-500f237b492c" acquired by "delete_volume" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:03 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e23bc2e-1b02-49fa-aa9c-8ce1bd9db0b9]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f0cb5904-83ee-419f-ac5c-52c2a3e0d9e5 tempest-AttachVolumeShelveTestJSON-925670451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ecb9f44f-7a27-4dde-9d8a-500f237b492c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:03 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ecb9f44f-7a27-4dde-9d8a-500f237b492c Sep 07 13:52:03 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:03 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f0cb5904-83ee-419f-ac5c-52c2a3e0d9e5 tempest-AttachVolumeShelveTestJSON-925670451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ecb9f44f-7a27-4dde-9d8a-500f237b492c" returned: 0 in 0.551s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f0cb5904-83ee-419f-ac5c-52c2a3e0d9e5 tempest-AttachVolumeShelveTestJSON-925670451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ecb9f44f-7a27-4dde-9d8a-500f237b492c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:03 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ecb9f44f-7a27-4dde-9d8a-500f237b492c Sep 07 13:52:03 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:04 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f0cb5904-83ee-419f-ac5c-52c2a3e0d9e5 tempest-AttachVolumeShelveTestJSON-925670451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ecb9f44f-7a27-4dde-9d8a-500f237b492c" returned: 0 in 0.296s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f0cb5904-83ee-419f-ac5c-52c2a3e0d9e5 tempest-AttachVolumeShelveTestJSON-925670451 None] Lock "cinder-quobyte-ecb9f44f-7a27-4dde-9d8a-500f237b492c" released by "delete_volume" :: held 0.905s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-f0cb5904-83ee-419f-ac5c-52c2a3e0d9e5 tempest-AttachVolumeShelveTestJSON-925670451 None] Created reservations ['f529d132-4c23-4924-9c96-84080161c695', '5d9c6790-9ed0-4808-b2da-f581eb7fc381', '98cebc47-2212-4634-aa1d-23900413097a', '18a00956-7156-4d78-ba02-7f25b1a51fb9'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f0cb5904-83ee-419f-ac5c-52c2a3e0d9e5 tempest-AttachVolumeShelveTestJSON-925670451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f0cb5904-83ee-419f-ac5c-52c2a3e0d9e5 tempest-AttachVolumeShelveTestJSON-925670451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f0cb5904-83ee-419f-ac5c-52c2a3e0d9e5 tempest-AttachVolumeShelveTestJSON-925670451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f0cb5904-83ee-419f-ac5c-52c2a3e0d9e5 tempest-AttachVolumeShelveTestJSON-925670451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f0cb5904-83ee-419f-ac5c-52c2a3e0d9e5 tempest-AttachVolumeShelveTestJSON-925670451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f0cb5904-83ee-419f-ac5c-52c2a3e0d9e5 tempest-AttachVolumeShelveTestJSON-925670451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:04 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:52:04 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Flow 'volume_create_manager' (e190d809-d81b-4c54-ac47-8c003eb7e61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624ab8b6-2276-42ee-a7f6-7560abefc93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624ab8b6-2276-42ee-a7f6-7560abefc93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1482109009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a8974a-ebd0-426d-8fc9-bf1ca6fbd706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19122d9006f34d55b05475df89fde118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:04Z,use_quota=True,user_id='63fee4210b564199a246237ce176748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1b84c9-1610-4ba7-ac60-b48af3c9656c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1b84c9-1610-4ba7-ac60-b48af3c9656c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1bf8f0c-46f5-4cc0-8cf9-937323c560e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1bf8f0c-46f5-4cc0-8cf9-937323c560e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89a8974a-ebd0-426d-8fc9-bf1ca6fbd706', 'volume_name': 'volume-89a8974a-ebd0-426d-8fc9-bf1ca6fbd706', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2becc6f4-db1b-448e-8aa8-9d1202864b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2becc6f4-db1b-448e-8aa8-9d1202864b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f6b104-50d5-4901-a6cc-a155c7f6faf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:04 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Volume 89a8974a-ebd0-426d-8fc9-bf1ca6fbd706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89a8974a-ebd0-426d-8fc9-bf1ca6fbd706', 'volume_size': 1} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1482109009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a8974a-ebd0-426d-8fc9-bf1ca6fbd706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19122d9006f34d55b05475df89fde118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:04Z,use_quota=True,user_id='63fee4210b564199a246237ce176748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Creating volume 89a8974a-ebd0-426d-8fc9-bf1ca6fbd706 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:52:04 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-89a8974a-ebd0-426d-8fc9-bf1ca6fbd706 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:04 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-89a8974a-ebd0-426d-8fc9-bf1ca6fbd706 1073741824 Sep 07 13:52:04 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:04 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f0cb5904-83ee-419f-ac5c-52c2a3e0d9e5 tempest-AttachVolumeShelveTestJSON-925670451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.492s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-f0cb5904-83ee-419f-ac5c-52c2a3e0d9e5 tempest-AttachVolumeShelveTestJSON-925670451 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:52:04 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-f0cb5904-83ee-419f-ac5c-52c2a3e0d9e5 tempest-AttachVolumeShelveTestJSON-925670451 None] Deleted volume successfully. Sep 07 13:52:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f0cb5904-83ee-419f-ac5c-52c2a3e0d9e5 tempest-AttachVolumeShelveTestJSON-925670451 None] Lock "cinder-ecb9f44f-7a27-4dde-9d8a-500f237b492c-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:05 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-89a8974a-ebd0-426d-8fc9-bf1ca6fbd706 1073741824" returned: 0 in 0.618s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-89a8974a-ebd0-426d-8fc9-bf1ca6fbd706 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:05 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-89a8974a-ebd0-426d-8fc9-bf1ca6fbd706 Sep 07 13:52:05 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:05 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-89a8974a-ebd0-426d-8fc9-bf1ca6fbd706" returned: 0 in 0.514s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:52:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f6b104-50d5-4901-a6cc-a155c7f6faf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89a8974a-ebd0-426d-8fc9-bf1ca6fbd706', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c23c559-ad6e-42fb-a243-0f3852f5d436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:05 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Volume volume-89a8974a-ebd0-426d-8fc9-bf1ca6fbd706 (89a8974a-ebd0-426d-8fc9-bf1ca6fbd706): created successfully Sep 07 13:52:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c23c559-ad6e-42fb-a243-0f3852f5d436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Flow 'volume_create_manager' (e190d809-d81b-4c54-ac47-8c003eb7e61b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:05 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-23e4e399-4830-4bcc-84aa-73cc0c922b5c tempest-VolumesNegativeTest-489480946 None] Created volume successfully. Sep 07 13:52:15 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:UPDATE=132,cinder:SELECT=122,cinder:DELETE=10,cinder:INSERT=46 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:52:15 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=113,cinder:INSERT=54,cinder:UPDATE=142,cinder:DELETE=12 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Flow 'volume_create_manager' (4a29f0e5-edca-4ea4-b2d6-2a5a2a091658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbb6b0e-9d7a-428c-8c1b-fe0c3d9fa6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbb6b0e-9d7a-428c-8c1b-fe0c3d9fa6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-335865775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee4f461-c874-42e3-b912-a88cf645427f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a6114a89664e8e9a0642fafa03f56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:18Z,use_quota=True,user_id='356e3e0715e94982968ab2c31ecd7161',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca37b00-54a0-4645-a0f0-1cf0cd9a9c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca37b00-54a0-4645-a0f0-1cf0cd9a9c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e4338c-bc28-4c62-8d68-4cc5a7ec0d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e4338c-bc28-4c62-8d68-4cc5a7ec0d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cee4f461-c874-42e3-b912-a88cf645427f', 'volume_name': 'volume-cee4f461-c874-42e3-b912-a88cf645427f', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00481ddd-b48a-4136-acbd-c9886c235131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00481ddd-b48a-4136-acbd-c9886c235131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd16e73-e8bc-4bca-ba9f-194f093553de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:18 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Volume cee4f461-c874-42e3-b912-a88cf645427f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cee4f461-c874-42e3-b912-a88cf645427f', 'volume_size': 1} Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-335865775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee4f461-c874-42e3-b912-a88cf645427f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a6114a89664e8e9a0642fafa03f56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:18Z,use_quota=True,user_id='356e3e0715e94982968ab2c31ecd7161',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Creating volume cee4f461-c874-42e3-b912-a88cf645427f {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:52:18 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:18 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f 1073741824 Sep 07 13:52:18 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:18 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f 1073741824" returned: 0 in 0.614s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:18 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f Sep 07 13:52:18 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:19 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f" returned: 0 in 0.441s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:19 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:52:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:19 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd16e73-e8bc-4bca-ba9f-194f093553de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cee4f461-c874-42e3-b912-a88cf645427f', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:19 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38000c9c-a799-42da-998b-3b85f0d1ab5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:19 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Volume volume-cee4f461-c874-42e3-b912-a88cf645427f (cee4f461-c874-42e3-b912-a88cf645427f): created successfully Sep 07 13:52:19 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38000c9c-a799-42da-998b-3b85f0d1ab5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:19 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Flow 'volume_create_manager' (4a29f0e5-edca-4ea4-b2d6-2a5a2a091658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:19 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-168152c0-5e6a-4385-9442-656c3dca674f tempest-VolumesSnapshotTestJSON-854675887 None] Created volume successfully. Sep 07 13:52:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c493e0d1-4176-4ddb-a973-37a1e9482cda tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c493e0d1-4176-4ddb-a973-37a1e9482cda tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-c493e0d1-4176-4ddb-a973-37a1e9482cda tempest-VolumesSnapshotTestJSON-854675887 None] Creating offline snapshot fd12188a-6771-4185-be7e-e1f627a5b35f of volume cee4f461-c874-42e3-b912-a88cf645427f {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:52:20 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6daf6d-047e-49af-ad56-c0cc22b657a4]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c493e0d1-4176-4ddb-a973-37a1e9482cda tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:21 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f Sep 07 13:52:21 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:21 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c493e0d1-4176-4ddb-a973-37a1e9482cda tempest-VolumesSnapshotTestJSON-854675887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f" returned: 0 in 0.743s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c493e0d1-4176-4ddb-a973-37a1e9482cda tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.fd12188a-6771-4185-be7e-e1f627a5b35f 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:21 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.fd12188a-6771-4185-be7e-e1f627a5b35f 1G Sep 07 13:52:21 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:22 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c493e0d1-4176-4ddb-a973-37a1e9482cda tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.fd12188a-6771-4185-be7e-e1f627a5b35f 1G" returned: 0 in 0.490s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c493e0d1-4176-4ddb-a973-37a1e9482cda tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cee4f461-c874-42e3-b912-a88cf645427f -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.fd12188a-6771-4185-be7e-e1f627a5b35f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:22 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cee4f461-c874-42e3-b912-a88cf645427f -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.fd12188a-6771-4185-be7e-e1f627a5b35f Sep 07 13:52:22 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:22 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c493e0d1-4176-4ddb-a973-37a1e9482cda tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cee4f461-c874-42e3-b912-a88cf645427f -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.fd12188a-6771-4185-be7e-e1f627a5b35f" returned: 0 in 0.382s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:22 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-c493e0d1-4176-4ddb-a973-37a1e9482cda tempest-VolumesSnapshotTestJSON-854675887 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.fd12188a-6771-4185-be7e-e1f627a5b35f is being set with open permissions: ugo+rw Sep 07 13:52:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c493e0d1-4176-4ddb-a973-37a1e9482cda tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.fd12188a-6771-4185-be7e-e1f627a5b35f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:22 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.fd12188a-6771-4185-be7e-e1f627a5b35f Sep 07 13:52:22 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:22 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c493e0d1-4176-4ddb-a973-37a1e9482cda tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.fd12188a-6771-4185-be7e-e1f627a5b35f" returned: 0 in 0.315s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c493e0d1-4176-4ddb-a973-37a1e9482cda tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:23 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.info Sep 07 13:52:23 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:23 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c493e0d1-4176-4ddb-a973-37a1e9482cda tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.info" returned: 0 in 0.530s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:23 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-c493e0d1-4176-4ddb-a973-37a1e9482cda tempest-VolumesSnapshotTestJSON-854675887 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.info is being set with open permissions: ugo+rw Sep 07 13:52:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c493e0d1-4176-4ddb-a973-37a1e9482cda tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:23 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.info Sep 07 13:52:23 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:23 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c493e0d1-4176-4ddb-a973-37a1e9482cda tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.info" returned: 0 in 0.420s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c493e0d1-4176-4ddb-a973-37a1e9482cda tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.100s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:24 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c493e0d1-4176-4ddb-a973-37a1e9482cda tempest-VolumesSnapshotTestJSON-854675887 None] Create snapshot completed successfully Sep 07 13:52:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d159b904-6964-45dc-b226-4c3a6cf08908 tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "cinder-fd12188a-6771-4185-be7e-e1f627a5b35f-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d159b904-6964-45dc-b226-4c3a6cf08908 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-fd12188a-6771-4185-be7e-e1f627a5b35f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d159b904-6964-45dc-b226-4c3a6cf08908 tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "cinder-quobyte-cee4f461-c874-42e3-b912-a88cf645427f" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d159b904-6964-45dc-b226-4c3a6cf08908 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-cee4f461-c874-42e3-b912-a88cf645427f" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d159b904-6964-45dc-b226-4c3a6cf08908 tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "cinder-quobyte-fd12188a-6771-4185-be7e-e1f627a5b35f" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d159b904-6964-45dc-b226-4c3a6cf08908 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-fd12188a-6771-4185-be7e-e1f627a5b35f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-d159b904-6964-45dc-b226-4c3a6cf08908 tempest-VolumesSnapshotTestJSON-854675887 None] Deleting offline snapshot fd12188a-6771-4185-be7e-e1f627a5b35f of volume cee4f461-c874-42e3-b912-a88cf645427f {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:52:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-d159b904-6964-45dc-b226-4c3a6cf08908 tempest-VolumesSnapshotTestJSON-854675887 None] snapshot_file for this snap is: volume-cee4f461-c874-42e3-b912-a88cf645427f.fd12188a-6771-4185-be7e-e1f627a5b35f {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:52:25 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffe9177-458e-4328-8eec-9775271b21e7]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d159b904-6964-45dc-b226-4c3a6cf08908 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.fd12188a-6771-4185-be7e-e1f627a5b35f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:25 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.fd12188a-6771-4185-be7e-e1f627a5b35f Sep 07 13:52:25 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:26 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d159b904-6964-45dc-b226-4c3a6cf08908 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.fd12188a-6771-4185-be7e-e1f627a5b35f" returned: 0 in 0.468s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:26 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-d159b904-6964-45dc-b226-4c3a6cf08908 tempest-VolumesSnapshotTestJSON-854675887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cee4f461-c874-42e3-b912-a88cf645427f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:52:26 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c4f31c-d7ee-4935-abf2-8fc80190cf1c]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d159b904-6964-45dc-b226-4c3a6cf08908 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:26 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f Sep 07 13:52:26 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:26 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d159b904-6964-45dc-b226-4c3a6cf08908 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f" returned: 0 in 0.547s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d159b904-6964-45dc-b226-4c3a6cf08908 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.fd12188a-6771-4185-be7e-e1f627a5b35f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:26 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.fd12188a-6771-4185-be7e-e1f627a5b35f Sep 07 13:52:26 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:27 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d159b904-6964-45dc-b226-4c3a6cf08908 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.fd12188a-6771-4185-be7e-e1f627a5b35f" returned: 0 in 0.701s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d159b904-6964-45dc-b226-4c3a6cf08908 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.fd12188a-6771-4185-be7e-e1f627a5b35f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:27 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.fd12188a-6771-4185-be7e-e1f627a5b35f Sep 07 13:52:27 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:27 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-7c7baf3b-7c40-495d-935d-06ea5550bcb5 req-0078788d-da23-4c8e-b736-ccdd875c96d4 tempest-TestShelveInstance-1626297668 None] Terminate volume connection completed successfully. Sep 07 13:52:27 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-7c7baf3b-7c40-495d-935d-06ea5550bcb5 req-0078788d-da23-4c8e-b736-ccdd875c96d4 tempest-TestShelveInstance-1626297668 None] Deleting attachment a344fa6d-3256-4075-8652-8302c529d01a. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:52:27 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d159b904-6964-45dc-b226-4c3a6cf08908 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f.fd12188a-6771-4185-be7e-e1f627a5b35f" returned: 0 in 0.526s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:27 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d159b904-6964-45dc-b226-4c3a6cf08908 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-fd12188a-6771-4185-be7e-e1f627a5b35f" released by "_delete_snapshot" :: held 2.415s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d159b904-6964-45dc-b226-4c3a6cf08908 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-cee4f461-c874-42e3-b912-a88cf645427f" released by "delete_snapshot" :: held 2.449s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:28 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-d159b904-6964-45dc-b226-4c3a6cf08908 tempest-VolumesSnapshotTestJSON-854675887 None] Created reservations ['962ebb2d-bc4d-4203-8ee4-24d21c313dc8', 'bee7b765-e21b-4328-9851-7847a7ce866d', '34b08f8e-9fd2-43af-b436-0be0f041c7ed', '37717b8b-cca3-463f-ae0c-8fd29c5d7d4e'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:52:28 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-d159b904-6964-45dc-b226-4c3a6cf08908 tempest-VolumesSnapshotTestJSON-854675887 None] Delete snapshot completed successfully. Sep 07 13:52:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d159b904-6964-45dc-b226-4c3a6cf08908 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-fd12188a-6771-4185-be7e-e1f627a5b35f-delete_snapshot" released by "delete_snapshot" :: held 2.735s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:52:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:28 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:52:28 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:28 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.336s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:52:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager._thread_info {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:52:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread count: 28 {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:52:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread info: [<_MainThread(MainThread, started 132147689414784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:52:29 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:52:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Flow 'volume_create_manager' (615e3f7c-9d6e-40e4-8dd6-8b80ac19a41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d935caa-0fd8-42bb-a802-0e1fd2be6940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d935caa-0fd8-42bb-a802-0e1fd2be6940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1657575750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b167c7d-07ad-4337-87c8-02d790b0890c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a6114a89664e8e9a0642fafa03f56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:29Z,use_quota=True,user_id='356e3e0715e94982968ab2c31ecd7161',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44ff481-f573-4053-a742-509fa48c50ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44ff481-f573-4053-a742-509fa48c50ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (976f2a50-2ccf-4def-b4a5-780b154e5c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (976f2a50-2ccf-4def-b4a5-780b154e5c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b167c7d-07ad-4337-87c8-02d790b0890c', 'volume_name': 'volume-3b167c7d-07ad-4337-87c8-02d790b0890c', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbebd759-1507-457d-8aa5-1638108fe632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbebd759-1507-457d-8aa5-1638108fe632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57144f8a-f646-420a-95d6-9c9eb8c082f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:29 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Volume 3b167c7d-07ad-4337-87c8-02d790b0890c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b167c7d-07ad-4337-87c8-02d790b0890c', 'volume_size': 1} Sep 07 13:52:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1657575750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b167c7d-07ad-4337-87c8-02d790b0890c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a6114a89664e8e9a0642fafa03f56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:29Z,use_quota=True,user_id='356e3e0715e94982968ab2c31ecd7161',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:52:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Creating volume 3b167c7d-07ad-4337-87c8-02d790b0890c {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:52:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:52:29 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:52:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:29 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c 1073741824 Sep 07 13:52:29 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:30 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c 1073741824" returned: 0 in 0.620s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:30 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c Sep 07 13:52:30 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:30 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c" returned: 0 in 0.356s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:52:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57144f8a-f646-420a-95d6-9c9eb8c082f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b167c7d-07ad-4337-87c8-02d790b0890c', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e58252-6e7e-43ec-b837-8617df616262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:30 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Volume volume-3b167c7d-07ad-4337-87c8-02d790b0890c (3b167c7d-07ad-4337-87c8-02d790b0890c): created successfully Sep 07 13:52:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e58252-6e7e-43ec-b837-8617df616262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Flow 'volume_create_manager' (615e3f7c-9d6e-40e4-8dd6-8b80ac19a41d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-c6e1698c-948c-4b04-91d9-d9b62596ff4a req-f1b3a067-48ed-4975-b678-006ef2430ce2 tempest-TestShelveInstance-1626297668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-c6e1698c-948c-4b04-91d9-d9b62596ff4a req-f1b3a067-48ed-4975-b678-006ef2430ce2 tempest-TestShelveInstance-1626297668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-c6e1698c-948c-4b04-91d9-d9b62596ff4a req-f1b3a067-48ed-4975-b678-006ef2430ce2 tempest-TestShelveInstance-1626297668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:30 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-d9635e45-6457-4ef1-b527-28b7ff8317fe tempest-VolumesSnapshotTestJSON-854675887 None] Created volume successfully. Sep 07 13:52:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-c6e1698c-948c-4b04-91d9-d9b62596ff4a req-f1b3a067-48ed-4975-b678-006ef2430ce2 tempest-TestShelveInstance-1626297668 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285', 'name': 'volume-664cac84-7c2e-4092-a58f-4219c6065d08', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28a5b43a-e449-4d79-95c4-613859a6e4c9', 'enforce_multipath': True} {{(pid=87571) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:52:30 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-c6e1698c-948c-4b04-91d9-d9b62596ff4a req-f1b3a067-48ed-4975-b678-006ef2430ce2 tempest-TestShelveInstance-1626297668 None] attachment_update completed successfully. Sep 07 13:52:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3c895f38-5ade-45b4-9e63-f93e5226e342 tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3c895f38-5ade-45b4-9e63-f93e5226e342 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-3c895f38-5ade-45b4-9e63-f93e5226e342 tempest-VolumesSnapshotTestJSON-854675887 None] Creating offline snapshot 193c5f97-4449-4b22-a054-ed28b7fcf557 of volume 3b167c7d-07ad-4337-87c8-02d790b0890c {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:52:31 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3275e4b2-8d32-4c68-8bd7-e9091022ed4d]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c895f38-5ade-45b4-9e63-f93e5226e342 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:32 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c Sep 07 13:52:32 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:32 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c895f38-5ade-45b4-9e63-f93e5226e342 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c" returned: 0 in 0.474s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c895f38-5ade-45b4-9e63-f93e5226e342 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.193c5f97-4449-4b22-a054-ed28b7fcf557 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:32 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.193c5f97-4449-4b22-a054-ed28b7fcf557 1G Sep 07 13:52:32 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:33 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c895f38-5ade-45b4-9e63-f93e5226e342 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.193c5f97-4449-4b22-a054-ed28b7fcf557 1G" returned: 0 in 0.552s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c895f38-5ade-45b4-9e63-f93e5226e342 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b167c7d-07ad-4337-87c8-02d790b0890c -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.193c5f97-4449-4b22-a054-ed28b7fcf557 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:33 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b167c7d-07ad-4337-87c8-02d790b0890c -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.193c5f97-4449-4b22-a054-ed28b7fcf557 Sep 07 13:52:33 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:33 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c895f38-5ade-45b4-9e63-f93e5226e342 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b167c7d-07ad-4337-87c8-02d790b0890c -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.193c5f97-4449-4b22-a054-ed28b7fcf557" returned: 0 in 0.413s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:33 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-3c895f38-5ade-45b4-9e63-f93e5226e342 tempest-VolumesSnapshotTestJSON-854675887 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.193c5f97-4449-4b22-a054-ed28b7fcf557 is being set with open permissions: ugo+rw Sep 07 13:52:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c895f38-5ade-45b4-9e63-f93e5226e342 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.193c5f97-4449-4b22-a054-ed28b7fcf557 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:33 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.193c5f97-4449-4b22-a054-ed28b7fcf557 Sep 07 13:52:33 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:33 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c895f38-5ade-45b4-9e63-f93e5226e342 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.193c5f97-4449-4b22-a054-ed28b7fcf557" returned: 0 in 0.349s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c895f38-5ade-45b4-9e63-f93e5226e342 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:33 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.info Sep 07 13:52:33 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:34 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c895f38-5ade-45b4-9e63-f93e5226e342 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.info" returned: 0 in 0.428s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:34 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-3c895f38-5ade-45b4-9e63-f93e5226e342 tempest-VolumesSnapshotTestJSON-854675887 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.info is being set with open permissions: ugo+rw Sep 07 13:52:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c895f38-5ade-45b4-9e63-f93e5226e342 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:34 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.info Sep 07 13:52:34 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:34 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c895f38-5ade-45b4-9e63-f93e5226e342 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.info" returned: 0 in 0.367s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3c895f38-5ade-45b4-9e63-f93e5226e342 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.758s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:34 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-3c895f38-5ade-45b4-9e63-f93e5226e342 tempest-VolumesSnapshotTestJSON-854675887 None] Create snapshot completed successfully Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Flow 'volume_create_manager' (3f83f767-706f-41e8-8d21-21c55ca42d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4734cef-41e9-4121-b117-1c078e56ed2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4734cef-41e9-4121-b117-1c078e56ed2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2029548345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6919fe1d-581e-4a87-8844-eb88539c94ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a6114a89664e8e9a0642fafa03f56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=193c5f97-4449-4b22-a054-ed28b7fcf557,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:36Z,use_quota=True,user_id='356e3e0715e94982968ab2c31ecd7161',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9501f9b-5fee-477e-b670-d8f6d9ceb3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9501f9b-5fee-477e-b670-d8f6d9ceb3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b6bf02-c577-4b1f-a88a-249fda365b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b6bf02-c577-4b1f-a88a-249fda365b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6919fe1d-581e-4a87-8844-eb88539c94ae', 'volume_name': 'volume-6919fe1d-581e-4a87-8844-eb88539c94ae', 'volume_size': 2, 'snapshot_id': '193c5f97-4449-4b22-a054-ed28b7fcf557'}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207fdc35-c4b5-4f30-b992-6d7db62119cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207fdc35-c4b5-4f30-b992-6d7db62119cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbdbef4e-dbb4-4104-abdd-c6b4158db789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:36 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Volume 6919fe1d-581e-4a87-8844-eb88539c94ae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6919fe1d-581e-4a87-8844-eb88539c94ae', 'volume_size': 2, 'snapshot_id': '193c5f97-4449-4b22-a054-ed28b7fcf557'} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "cinder-quobyte-193c5f97-4449-4b22-a054-ed28b7fcf557-6919fe1d-581e-4a87-8844-eb88539c94ae" by "_create_volume_from_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-193c5f97-4449-4b22-a054-ed28b7fcf557-6919fe1d-581e-4a87-8844-eb88539c94ae" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Creating volume 6919fe1d-581e-4a87-8844-eb88539c94ae from snapshot 193c5f97-4449-4b22-a054-ed28b7fcf557 {{(pid=87571) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "cinder-quobyte-6919fe1d-581e-4a87-8844-eb88539c94ae" by "_copy_volume_from_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-69736de7-6d5d-4079-a36e-83448fa7062a tempest-VolumesNegativeTest-489480946 None] Acquiring lock "cinder-89a8974a-ebd0-426d-8fc9-bf1ca6fbd706-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-6919fe1d-581e-4a87-8844-eb88539c94ae" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] snapshot: 193c5f97-4449-4b22-a054-ed28b7fcf557, volume: 6919fe1d-581e-4a87-8844-eb88539c94ae, {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-69736de7-6d5d-4079-a36e-83448fa7062a tempest-VolumesNegativeTest-489480946 None] Lock "cinder-89a8974a-ebd0-426d-8fc9-bf1ca6fbd706-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9689f91-edbf-4ba9-b172-0aaa7267dcbf]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.193c5f97-4449-4b22-a054-ed28b7fcf557 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-69736de7-6d5d-4079-a36e-83448fa7062a tempest-VolumesNegativeTest-489480946 None] Acquiring lock "cinder-quobyte-89a8974a-ebd0-426d-8fc9-bf1ca6fbd706" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-69736de7-6d5d-4079-a36e-83448fa7062a tempest-VolumesNegativeTest-489480946 None] Lock "cinder-quobyte-89a8974a-ebd0-426d-8fc9-bf1ca6fbd706" acquired by "delete_volume" :: waited 0.025s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[547b4b09-19c7-4756-bb9c-97d8796bca34]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-69736de7-6d5d-4079-a36e-83448fa7062a tempest-VolumesNegativeTest-489480946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-89a8974a-ebd0-426d-8fc9-bf1ca6fbd706 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:37 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.193c5f97-4449-4b22-a054-ed28b7fcf557 Sep 07 13:52:37 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:37 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-89a8974a-ebd0-426d-8fc9-bf1ca6fbd706 Sep 07 13:52:37 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:37 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-69736de7-6d5d-4079-a36e-83448fa7062a tempest-VolumesNegativeTest-489480946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-89a8974a-ebd0-426d-8fc9-bf1ca6fbd706" returned: 0 in 0.540s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-69736de7-6d5d-4079-a36e-83448fa7062a tempest-VolumesNegativeTest-489480946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-89a8974a-ebd0-426d-8fc9-bf1ca6fbd706 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:37 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-89a8974a-ebd0-426d-8fc9-bf1ca6fbd706 Sep 07 13:52:37 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:37 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.193c5f97-4449-4b22-a054-ed28b7fcf557" returned: 0 in 0.732s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:37 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b167c7d-07ad-4337-87c8-02d790b0890c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:52:37 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb445b48-2adc-4cc1-903e-8c7fa1217464]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:37 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c Sep 07 13:52:37 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:37 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-69736de7-6d5d-4079-a36e-83448fa7062a tempest-VolumesNegativeTest-489480946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-89a8974a-ebd0-426d-8fc9-bf1ca6fbd706" returned: 0 in 0.371s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:37 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-69736de7-6d5d-4079-a36e-83448fa7062a tempest-VolumesNegativeTest-489480946 None] Lock "cinder-quobyte-89a8974a-ebd0-426d-8fc9-bf1ca6fbd706" released by "delete_volume" :: held 0.997s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:38 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-69736de7-6d5d-4079-a36e-83448fa7062a tempest-VolumesNegativeTest-489480946 None] Created reservations ['c7a43886-6386-4289-901e-9631ff2e89c1', 'bc273e49-6064-4214-955e-b6462de96594', 'efee8ad3-9c29-4648-a6b9-c8743ca0f98a', '3db2ce03-96d4-4340-9c29-bdad104f025e'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:52:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-69736de7-6d5d-4079-a36e-83448fa7062a tempest-VolumesNegativeTest-489480946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-69736de7-6d5d-4079-a36e-83448fa7062a tempest-VolumesNegativeTest-489480946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-69736de7-6d5d-4079-a36e-83448fa7062a tempest-VolumesNegativeTest-489480946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-69736de7-6d5d-4079-a36e-83448fa7062a tempest-VolumesNegativeTest-489480946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-69736de7-6d5d-4079-a36e-83448fa7062a tempest-VolumesNegativeTest-489480946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-69736de7-6d5d-4079-a36e-83448fa7062a tempest-VolumesNegativeTest-489480946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:38 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:52:38 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:38 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c" returned: 0 in 0.511s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 13:52:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Creating direct copy from snapshot {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 13:52:38 devstack cinder-volume[87571]: DEBUG cinder.utils [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Path /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6919fe1d-581e-4a87-8844-eb88539c94ae not found in is_blk_device check {{(pid=87571) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 13:52:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6919fe1d-581e-4a87-8844-eb88539c94ae {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:38 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6919fe1d-581e-4a87-8844-eb88539c94ae Sep 07 13:52:38 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:38 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-69736de7-6d5d-4079-a36e-83448fa7062a tempest-VolumesNegativeTest-489480946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.402s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:38 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-69736de7-6d5d-4079-a36e-83448fa7062a tempest-VolumesNegativeTest-489480946 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:52:38 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-69736de7-6d5d-4079-a36e-83448fa7062a tempest-VolumesNegativeTest-489480946 None] Deleted volume successfully. Sep 07 13:52:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-69736de7-6d5d-4079-a36e-83448fa7062a tempest-VolumesNegativeTest-489480946 None] Lock "cinder-89a8974a-ebd0-426d-8fc9-bf1ca6fbd706-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:46 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6919fe1d-581e-4a87-8844-eb88539c94ae" returned: 0 in 8.125s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:46 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c, size 1024.00 MB, duration 8.13 sec, destination /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6919fe1d-581e-4a87-8844-eb88539c94ae {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:52:46 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Converted 1024.00 MB image at 126.02 MB/s Sep 07 13:52:46 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6919fe1d-581e-4a87-8844-eb88539c94ae is being set with open permissions: ugo+rw Sep 07 13:52:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6919fe1d-581e-4a87-8844-eb88539c94ae {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:46 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6919fe1d-581e-4a87-8844-eb88539c94ae Sep 07 13:52:46 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:46 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6919fe1d-581e-4a87-8844-eb88539c94ae" returned: 0 in 0.325s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:46 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-6919fe1d-581e-4a87-8844-eb88539c94ae" released by "_copy_volume_from_snapshot" :: held 9.822s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:46 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-193c5f97-4449-4b22-a054-ed28b7fcf557-6919fe1d-581e-4a87-8844-eb88539c94ae" released by "_create_volume_from_snapshot" :: held 9.924s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.952s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:46 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbdbef4e-dbb4-4104-abdd-c6b4158db789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6919fe1d-581e-4a87-8844-eb88539c94ae', 'volume_size': 2, 'snapshot_id': '193c5f97-4449-4b22-a054-ed28b7fcf557'}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:46 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a3b14d-20d5-47f3-85d4-627584eed475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:46 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Volume volume-6919fe1d-581e-4a87-8844-eb88539c94ae (6919fe1d-581e-4a87-8844-eb88539c94ae): created successfully Sep 07 13:52:46 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a3b14d-20d5-47f3-85d4-627584eed475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:46 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Flow 'volume_create_manager' (3f83f767-706f-41e8-8d21-21c55ca42d86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:46 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-409d1abf-dba8-4e5d-94ed-c961e821efd8 tempest-VolumesSnapshotTestJSON-854675887 None] Created volume successfully. Sep 07 13:52:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fc5fc381-4bcc-4950-be0b-92f86d8db281 tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "cinder-6919fe1d-581e-4a87-8844-eb88539c94ae-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fc5fc381-4bcc-4950-be0b-92f86d8db281 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-6919fe1d-581e-4a87-8844-eb88539c94ae-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fc5fc381-4bcc-4950-be0b-92f86d8db281 tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "cinder-quobyte-6919fe1d-581e-4a87-8844-eb88539c94ae" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fc5fc381-4bcc-4950-be0b-92f86d8db281 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-6919fe1d-581e-4a87-8844-eb88539c94ae" acquired by "delete_volume" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:48 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1445f579-7601-4100-9218-9665088314de]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fc5fc381-4bcc-4950-be0b-92f86d8db281 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6919fe1d-581e-4a87-8844-eb88539c94ae {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:48 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6919fe1d-581e-4a87-8844-eb88539c94ae Sep 07 13:52:48 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:48 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:52:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Flow 'volume_create_manager' (8f74db9c-9cd2-4d6b-b42f-21cf7c52ca4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076c7693-771a-4c70-897e-59be1db5621b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076c7693-771a-4c70-897e-59be1db5621b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1979746407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086d70a2-41a3-4454-abd2-8b70f8c1b733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a6b0eabc0424f449525262d903f1f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:49Z,use_quota=True,user_id='d3861170c2b8483d8f19daf84e91ffcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79895c1-0d66-4cf8-bc28-71ea50fe3156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79895c1-0d66-4cf8-bc28-71ea50fe3156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6e423f-aa04-416f-9cc8-58c6bcc37308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6e423f-aa04-416f-9cc8-58c6bcc37308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '086d70a2-41a3-4454-abd2-8b70f8c1b733', 'volume_name': 'volume-086d70a2-41a3-4454-abd2-8b70f8c1b733', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf87a5a-5018-4060-a6f8-844413513e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf87a5a-5018-4060-a6f8-844413513e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ad0eec-d562-40e1-a581-09dd1ed03ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:49 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Volume 086d70a2-41a3-4454-abd2-8b70f8c1b733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-086d70a2-41a3-4454-abd2-8b70f8c1b733', 'volume_size': 1} Sep 07 13:52:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:49 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1979746407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086d70a2-41a3-4454-abd2-8b70f8c1b733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a6b0eabc0424f449525262d903f1f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:49Z,use_quota=True,user_id='d3861170c2b8483d8f19daf84e91ffcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:52:49 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Creating volume 086d70a2-41a3-4454-abd2-8b70f8c1b733 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:52:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:49 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:49 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:49 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:52:49 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:52:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:49 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733 1073741824 Sep 07 13:52:49 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:49 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fc5fc381-4bcc-4950-be0b-92f86d8db281 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6919fe1d-581e-4a87-8844-eb88539c94ae" returned: 0 in 1.217s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fc5fc381-4bcc-4950-be0b-92f86d8db281 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6919fe1d-581e-4a87-8844-eb88539c94ae {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:49 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6919fe1d-581e-4a87-8844-eb88539c94ae Sep 07 13:52:49 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:50 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fc5fc381-4bcc-4950-be0b-92f86d8db281 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6919fe1d-581e-4a87-8844-eb88539c94ae" returned: 0 in 0.531s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:50 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fc5fc381-4bcc-4950-be0b-92f86d8db281 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-6919fe1d-581e-4a87-8844-eb88539c94ae" released by "delete_volume" :: held 1.912s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:50 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-fc5fc381-4bcc-4950-be0b-92f86d8db281 tempest-VolumesSnapshotTestJSON-854675887 None] Created reservations ['60006341-edbd-4490-9549-50ce0921d1f4', '5f93a738-a536-464c-9bea-9295fd9e1054', '3a49039d-e0b2-46c3-984f-2c1fea407dc2', '70525490-4f22-4e3c-90de-4950c95212eb'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:52:50 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733 1073741824" returned: 0 in 1.097s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fc5fc381-4bcc-4950-be0b-92f86d8db281 tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fc5fc381-4bcc-4950-be0b-92f86d8db281 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:50 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fc5fc381-4bcc-4950-be0b-92f86d8db281 tempest-VolumesSnapshotTestJSON-854675887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:50 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fc5fc381-4bcc-4950-be0b-92f86d8db281 tempest-VolumesSnapshotTestJSON-854675887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fc5fc381-4bcc-4950-be0b-92f86d8db281 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fc5fc381-4bcc-4950-be0b-92f86d8db281 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:50 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:52:50 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:50 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733 Sep 07 13:52:50 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:50 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fc5fc381-4bcc-4950-be0b-92f86d8db281 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.410s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:50 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-fc5fc381-4bcc-4950-be0b-92f86d8db281 tempest-VolumesSnapshotTestJSON-854675887 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:52:50 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-fc5fc381-4bcc-4950-be0b-92f86d8db281 tempest-VolumesSnapshotTestJSON-854675887 None] Deleted volume successfully. Sep 07 13:52:50 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fc5fc381-4bcc-4950-be0b-92f86d8db281 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-6919fe1d-581e-4a87-8844-eb88539c94ae-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:50 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733" returned: 0 in 0.675s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:50 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:52:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b890a137-6d51-4404-95f7-dc0e9a88c4eb tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "cinder-193c5f97-4449-4b22-a054-ed28b7fcf557-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ad0eec-d562-40e1-a581-09dd1ed03ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-086d70a2-41a3-4454-abd2-8b70f8c1b733', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8ea828f-ddc9-4c42-9913-3e49cbf98235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b890a137-6d51-4404-95f7-dc0e9a88c4eb tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-193c5f97-4449-4b22-a054-ed28b7fcf557-delete_snapshot" acquired by "delete_snapshot" :: waited 0.116s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b890a137-6d51-4404-95f7-dc0e9a88c4eb tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "cinder-quobyte-3b167c7d-07ad-4337-87c8-02d790b0890c" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b890a137-6d51-4404-95f7-dc0e9a88c4eb tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-3b167c7d-07ad-4337-87c8-02d790b0890c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b890a137-6d51-4404-95f7-dc0e9a88c4eb tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "cinder-quobyte-193c5f97-4449-4b22-a054-ed28b7fcf557" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:51 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Volume volume-086d70a2-41a3-4454-abd2-8b70f8c1b733 (086d70a2-41a3-4454-abd2-8b70f8c1b733): created successfully Sep 07 13:52:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8ea828f-ddc9-4c42-9913-3e49cbf98235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Flow 'volume_create_manager' (8f74db9c-9cd2-4d6b-b42f-21cf7c52ca4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:51 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-1b09e199-cb8a-4a47-af0d-c73657270c92 tempest-VolumesSnapshotListTestJSON-1450347923 None] Created volume successfully. Sep 07 13:52:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b890a137-6d51-4404-95f7-dc0e9a88c4eb tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-193c5f97-4449-4b22-a054-ed28b7fcf557" acquired by "_delete_snapshot" :: waited 0.064s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-b890a137-6d51-4404-95f7-dc0e9a88c4eb tempest-VolumesSnapshotTestJSON-854675887 None] Deleting offline snapshot 193c5f97-4449-4b22-a054-ed28b7fcf557 of volume 3b167c7d-07ad-4337-87c8-02d790b0890c {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:52:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-b890a137-6d51-4404-95f7-dc0e9a88c4eb tempest-VolumesSnapshotTestJSON-854675887 None] snapshot_file for this snap is: volume-3b167c7d-07ad-4337-87c8-02d790b0890c.193c5f97-4449-4b22-a054-ed28b7fcf557 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:52:51 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a293dd1d-cab9-48e1-a56d-067ab4cfa1a4]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b890a137-6d51-4404-95f7-dc0e9a88c4eb tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.193c5f97-4449-4b22-a054-ed28b7fcf557 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:51 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.193c5f97-4449-4b22-a054-ed28b7fcf557 Sep 07 13:52:51 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:51 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b890a137-6d51-4404-95f7-dc0e9a88c4eb tempest-VolumesSnapshotTestJSON-854675887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.193c5f97-4449-4b22-a054-ed28b7fcf557" returned: 0 in 0.570s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-b890a137-6d51-4404-95f7-dc0e9a88c4eb tempest-VolumesSnapshotTestJSON-854675887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b167c7d-07ad-4337-87c8-02d790b0890c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:52:51 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9784dbb8-4bc6-4362-a501-4d2b506958d8]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b890a137-6d51-4404-95f7-dc0e9a88c4eb tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:52 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c Sep 07 13:52:52 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5fd7bced-1623-43d2-a869-15ab4e94e750 tempest-VolumesSnapshotListTestJSON-1450347923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5fd7bced-1623-43d2-a869-15ab4e94e750 tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:52 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-5fd7bced-1623-43d2-a869-15ab4e94e750 tempest-VolumesSnapshotListTestJSON-1450347923 None] Creating offline snapshot 82a9bfe2-08fc-4e57-ab2a-d3d81c333aae of volume 086d70a2-41a3-4454-abd2-8b70f8c1b733 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:52:52 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f2a339-bac1-4e6a-add8-e93072ca7dba]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7bced-1623-43d2-a869-15ab4e94e750 tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:52 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733 Sep 07 13:52:52 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:52 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b890a137-6d51-4404-95f7-dc0e9a88c4eb tempest-VolumesSnapshotTestJSON-854675887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c" returned: 0 in 0.982s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b890a137-6d51-4404-95f7-dc0e9a88c4eb tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.193c5f97-4449-4b22-a054-ed28b7fcf557 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:52 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.193c5f97-4449-4b22-a054-ed28b7fcf557 Sep 07 13:52:52 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:53 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7bced-1623-43d2-a869-15ab4e94e750 tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733" returned: 0 in 0.560s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7bced-1623-43d2-a869-15ab4e94e750 tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:53 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae 1G Sep 07 13:52:53 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:53 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b890a137-6d51-4404-95f7-dc0e9a88c4eb tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.193c5f97-4449-4b22-a054-ed28b7fcf557" returned: 0 in 0.628s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b890a137-6d51-4404-95f7-dc0e9a88c4eb tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.193c5f97-4449-4b22-a054-ed28b7fcf557 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:53 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.193c5f97-4449-4b22-a054-ed28b7fcf557 Sep 07 13:52:53 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:53 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b890a137-6d51-4404-95f7-dc0e9a88c4eb tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c.193c5f97-4449-4b22-a054-ed28b7fcf557" returned: 0 in 0.334s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:53 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7bced-1623-43d2-a869-15ab4e94e750 tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae 1G" returned: 0 in 0.716s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7bced-1623-43d2-a869-15ab4e94e750 tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086d70a2-41a3-4454-abd2-8b70f8c1b733 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b890a137-6d51-4404-95f7-dc0e9a88c4eb tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-193c5f97-4449-4b22-a054-ed28b7fcf557" released by "_delete_snapshot" :: held 2.742s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:54 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086d70a2-41a3-4454-abd2-8b70f8c1b733 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae Sep 07 13:52:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b890a137-6d51-4404-95f7-dc0e9a88c4eb tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-3b167c7d-07ad-4337-87c8-02d790b0890c" released by "delete_snapshot" :: held 2.840s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:54 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:54 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-b890a137-6d51-4404-95f7-dc0e9a88c4eb tempest-VolumesSnapshotTestJSON-854675887 None] Created reservations ['8714cd0e-c57d-4031-b5a1-ebe13b3899f1', '140055b3-8ef6-4494-9151-d99abc8fde5e', '5d4267b3-ae9b-42d3-bd3d-cddf30a60ac4', '333a5e14-4725-4d7b-9759-a84e08e3b84b'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:52:54 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-b890a137-6d51-4404-95f7-dc0e9a88c4eb tempest-VolumesSnapshotTestJSON-854675887 None] Delete snapshot completed successfully. Sep 07 13:52:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b890a137-6d51-4404-95f7-dc0e9a88c4eb tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-193c5f97-4449-4b22-a054-ed28b7fcf557-delete_snapshot" released by "delete_snapshot" :: held 3.071s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-180355d4-39c2-48f8-b33b-8e3d32125b59 tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "cinder-3b167c7d-07ad-4337-87c8-02d790b0890c-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-180355d4-39c2-48f8-b33b-8e3d32125b59 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-3b167c7d-07ad-4337-87c8-02d790b0890c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-180355d4-39c2-48f8-b33b-8e3d32125b59 tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "cinder-quobyte-3b167c7d-07ad-4337-87c8-02d790b0890c" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-180355d4-39c2-48f8-b33b-8e3d32125b59 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-3b167c7d-07ad-4337-87c8-02d790b0890c" acquired by "delete_volume" :: waited 0.035s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:54 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7bced-1623-43d2-a869-15ab4e94e750 tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086d70a2-41a3-4454-abd2-8b70f8c1b733 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae" returned: 0 in 0.730s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:54 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-5fd7bced-1623-43d2-a869-15ab4e94e750 tempest-VolumesSnapshotListTestJSON-1450347923 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae is being set with open permissions: ugo+rw Sep 07 13:52:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7bced-1623-43d2-a869-15ab4e94e750 tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:54 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddfef58-b6b5-4d71-a9a5-b8e1fba6a9cf]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-180355d4-39c2-48f8-b33b-8e3d32125b59 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:54 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae Sep 07 13:52:54 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:54 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c Sep 07 13:52:54 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:55 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7bced-1623-43d2-a869-15ab4e94e750 tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae" returned: 0 in 0.420s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7bced-1623-43d2-a869-15ab4e94e750 tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:55 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.info Sep 07 13:52:55 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:55 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-180355d4-39c2-48f8-b33b-8e3d32125b59 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c" returned: 0 in 0.617s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-180355d4-39c2-48f8-b33b-8e3d32125b59 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:55 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c Sep 07 13:52:55 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:55 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7bced-1623-43d2-a869-15ab4e94e750 tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.info" returned: 0 in 0.391s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:55 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-5fd7bced-1623-43d2-a869-15ab4e94e750 tempest-VolumesSnapshotListTestJSON-1450347923 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.info is being set with open permissions: ugo+rw Sep 07 13:52:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7bced-1623-43d2-a869-15ab4e94e750 tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:55 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.info Sep 07 13:52:55 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:55 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-180355d4-39c2-48f8-b33b-8e3d32125b59 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3b167c7d-07ad-4337-87c8-02d790b0890c" returned: 0 in 0.563s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-180355d4-39c2-48f8-b33b-8e3d32125b59 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-3b167c7d-07ad-4337-87c8-02d790b0890c" released by "delete_volume" :: held 1.284s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:55 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7bced-1623-43d2-a869-15ab4e94e750 tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.info" returned: 0 in 0.413s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5fd7bced-1623-43d2-a869-15ab4e94e750 tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.368s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:56 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-180355d4-39c2-48f8-b33b-8e3d32125b59 tempest-VolumesSnapshotTestJSON-854675887 None] Created reservations ['997bf890-d39d-4c3b-8f50-433e74a3661b', 'd32bc401-4f47-4f02-8d57-299343ca6b38', '2b8a327d-1431-4a24-88fe-2c83c86b653a', '044b5458-cb4d-4dea-8f4a-883b7d0e06d6'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:52:56 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-5fd7bced-1623-43d2-a869-15ab4e94e750 tempest-VolumesSnapshotListTestJSON-1450347923 None] Create snapshot completed successfully Sep 07 13:52:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-180355d4-39c2-48f8-b33b-8e3d32125b59 tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-180355d4-39c2-48f8-b33b-8e3d32125b59 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-180355d4-39c2-48f8-b33b-8e3d32125b59 tempest-VolumesSnapshotTestJSON-854675887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-180355d4-39c2-48f8-b33b-8e3d32125b59 tempest-VolumesSnapshotTestJSON-854675887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-180355d4-39c2-48f8-b33b-8e3d32125b59 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-180355d4-39c2-48f8-b33b-8e3d32125b59 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:56 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:52:56 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:56 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-180355d4-39c2-48f8-b33b-8e3d32125b59 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.247s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:56 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-180355d4-39c2-48f8-b33b-8e3d32125b59 tempest-VolumesSnapshotTestJSON-854675887 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:52:56 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-180355d4-39c2-48f8-b33b-8e3d32125b59 tempest-VolumesSnapshotTestJSON-854675887 None] Deleted volume successfully. Sep 07 13:52:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-180355d4-39c2-48f8-b33b-8e3d32125b59 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-3b167c7d-07ad-4337-87c8-02d790b0890c-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-356db861-6164-46a1-aeac-7eaa6b991a04 tempest-VolumesSnapshotListTestJSON-1450347923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-356db861-6164-46a1-aeac-7eaa6b991a04 tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-356db861-6164-46a1-aeac-7eaa6b991a04 tempest-VolumesSnapshotListTestJSON-1450347923 None] Creating offline snapshot f140e27d-fde7-48c1-9963-454c6dd8ea5b of volume 086d70a2-41a3-4454-abd2-8b70f8c1b733 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:52:57 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bac44f-9252-4e46-8e1d-c35f3ad0fb59]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-356db861-6164-46a1-aeac-7eaa6b991a04 tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:57 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:52:57 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae Sep 07 13:52:57 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Flow 'volume_create_manager' (4bf04c09-9f14-44fe-9798-63e6189b2432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e7f86d-59eb-465a-981d-409cf5f29acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e7f86d-59eb-465a-981d-409cf5f29acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2076380271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094bcf72-d826-4a4b-8b4c-c244a219dfe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a6114a89664e8e9a0642fafa03f56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:57Z,use_quota=True,user_id='356e3e0715e94982968ab2c31ecd7161',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e005f8b-a8a6-4732-b754-372bc415d810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e005f8b-a8a6-4732-b754-372bc415d810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75f98bd-02ec-4512-9d72-b80b93af9342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75f98bd-02ec-4512-9d72-b80b93af9342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '094bcf72-d826-4a4b-8b4c-c244a219dfe6', 'volume_name': 'volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f229d275-0ca5-46ed-90f4-a1183ed5ca6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f229d275-0ca5-46ed-90f4-a1183ed5ca6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad6b027-9b74-46ab-94a9-c722b95340ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:57 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Volume 094bcf72-d826-4a4b-8b4c-c244a219dfe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6', 'volume_size': 1} Sep 07 13:52:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:57 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-356db861-6164-46a1-aeac-7eaa6b991a04 tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae" returned: 0 in 0.370s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-356db861-6164-46a1-aeac-7eaa6b991a04 tempest-VolumesSnapshotListTestJSON-1450347923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-086d70a2-41a3-4454-abd2-8b70f8c1b733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:52:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-356db861-6164-46a1-aeac-7eaa6b991a04 tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:57 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b 1G Sep 07 13:52:57 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:58 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-356db861-6164-46a1-aeac-7eaa6b991a04 tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b 1G" returned: 0 in 0.385s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-356db861-6164-46a1-aeac-7eaa6b991a04 tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:58 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b Sep 07 13:52:58 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:58 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-356db861-6164-46a1-aeac-7eaa6b991a04 tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b" returned: 0 in 0.276s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:58 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-356db861-6164-46a1-aeac-7eaa6b991a04 tempest-VolumesSnapshotListTestJSON-1450347923 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b is being set with open permissions: ugo+rw Sep 07 13:52:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-356db861-6164-46a1-aeac-7eaa6b991a04 tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:58 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b Sep 07 13:52:58 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:58 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-356db861-6164-46a1-aeac-7eaa6b991a04 tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b" returned: 0 in 0.229s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-356db861-6164-46a1-aeac-7eaa6b991a04 tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.347s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.098s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2076380271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094bcf72-d826-4a4b-8b4c-c244a219dfe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a6114a89664e8e9a0642fafa03f56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:57Z,use_quota=True,user_id='356e3e0715e94982968ab2c31ecd7161',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:52:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Creating volume 094bcf72-d826-4a4b-8b4c-c244a219dfe6 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:52:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:52:58 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:52:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:58 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6 1073741824 Sep 07 13:52:58 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:58 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-356db861-6164-46a1-aeac-7eaa6b991a04 tempest-VolumesSnapshotListTestJSON-1450347923 None] Create snapshot completed successfully Sep 07 13:52:59 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6 1073741824" returned: 0 in 0.407s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:59 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6 Sep 07 13:52:59 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:59 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6" returned: 0 in 0.253s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:59 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:52:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:59 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad6b027-9b74-46ab-94a9-c722b95340ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:59 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e00b05c5-bc6d-4016-a1e3-7bd11ffead9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:59 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Volume volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6 (094bcf72-d826-4a4b-8b4c-c244a219dfe6): created successfully Sep 07 13:52:59 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e00b05c5-bc6d-4016-a1e3-7bd11ffead9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:59 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Flow 'volume_create_manager' (4bf04c09-9f14-44fe-9798-63e6189b2432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:59 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-08861ec9-566a-462d-add8-a1aaaa26648c tempest-VolumesSnapshotTestJSON-854675887 None] Created volume successfully. Sep 07 13:52:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c9e52567-5b20-4be2-abc1-505679dbeee5 tempest-VolumesSnapshotListTestJSON-1450347923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c9e52567-5b20-4be2-abc1-505679dbeee5 tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:59 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-c9e52567-5b20-4be2-abc1-505679dbeee5 tempest-VolumesSnapshotListTestJSON-1450347923 None] Creating offline snapshot 21207801-ad72-4727-ae99-1074968d1e19 of volume 086d70a2-41a3-4454-abd2-8b70f8c1b733 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:52:59 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ddd82f-2ef1-41e9-ad62-e70d61669f5f]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c9e52567-5b20-4be2-abc1-505679dbeee5 tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:59 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b Sep 07 13:52:59 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:59 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c9e52567-5b20-4be2-abc1-505679dbeee5 tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b" returned: 0 in 0.353s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:59 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-c9e52567-5b20-4be2-abc1-505679dbeee5 tempest-VolumesSnapshotListTestJSON-1450347923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-086d70a2-41a3-4454-abd2-8b70f8c1b733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:52:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c9e52567-5b20-4be2-abc1-505679dbeee5 tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.21207801-ad72-4727-ae99-1074968d1e19 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:59 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.21207801-ad72-4727-ae99-1074968d1e19 1G Sep 07 13:52:59 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:00 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c9e52567-5b20-4be2-abc1-505679dbeee5 tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.21207801-ad72-4727-ae99-1074968d1e19 1G" returned: 0 in 0.385s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c9e52567-5b20-4be2-abc1-505679dbeee5 tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.21207801-ad72-4727-ae99-1074968d1e19 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:00 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.21207801-ad72-4727-ae99-1074968d1e19 Sep 07 13:53:00 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:00 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c9e52567-5b20-4be2-abc1-505679dbeee5 tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.21207801-ad72-4727-ae99-1074968d1e19" returned: 0 in 0.339s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:00 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-c9e52567-5b20-4be2-abc1-505679dbeee5 tempest-VolumesSnapshotListTestJSON-1450347923 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.21207801-ad72-4727-ae99-1074968d1e19 is being set with open permissions: ugo+rw Sep 07 13:53:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c9e52567-5b20-4be2-abc1-505679dbeee5 tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.21207801-ad72-4727-ae99-1074968d1e19 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:00 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.21207801-ad72-4727-ae99-1074968d1e19 Sep 07 13:53:00 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3df95a35-625c-4945-8c79-452113267a4a tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:00 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c9e52567-5b20-4be2-abc1-505679dbeee5 tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.21207801-ad72-4727-ae99-1074968d1e19" returned: 0 in 0.250s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c9e52567-5b20-4be2-abc1-505679dbeee5 tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.413s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3df95a35-625c-4945-8c79-452113267a4a tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.221s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:00 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-3df95a35-625c-4945-8c79-452113267a4a tempest-VolumesSnapshotTestJSON-854675887 None] Creating offline snapshot e8566bd9-f201-4224-97c3-696500870d0c of volume 094bcf72-d826-4a4b-8b4c-c244a219dfe6 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:53:00 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c9e52567-5b20-4be2-abc1-505679dbeee5 tempest-VolumesSnapshotListTestJSON-1450347923 None] Create snapshot completed successfully Sep 07 13:53:00 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d98690d-66a5-4786-b18c-e08bb5211cc0]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3df95a35-625c-4945-8c79-452113267a4a tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:01 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6 Sep 07 13:53:01 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:01 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3df95a35-625c-4945-8c79-452113267a4a tempest-VolumesSnapshotTestJSON-854675887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6" returned: 0 in 0.361s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3df95a35-625c-4945-8c79-452113267a4a tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.e8566bd9-f201-4224-97c3-696500870d0c 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:01 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.e8566bd9-f201-4224-97c3-696500870d0c 1G Sep 07 13:53:01 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:01 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3df95a35-625c-4945-8c79-452113267a4a tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.e8566bd9-f201-4224-97c3-696500870d0c 1G" returned: 0 in 0.427s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3df95a35-625c-4945-8c79-452113267a4a tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.e8566bd9-f201-4224-97c3-696500870d0c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:01 devstack sudo[99009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.e8566bd9-f201-4224-97c3-696500870d0c Sep 07 13:53:01 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:02 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3df95a35-625c-4945-8c79-452113267a4a tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.e8566bd9-f201-4224-97c3-696500870d0c" returned: 0 in 0.398s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:02 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-3df95a35-625c-4945-8c79-452113267a4a tempest-VolumesSnapshotTestJSON-854675887 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.e8566bd9-f201-4224-97c3-696500870d0c is being set with open permissions: ugo+rw Sep 07 13:53:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3df95a35-625c-4945-8c79-452113267a4a tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.e8566bd9-f201-4224-97c3-696500870d0c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:02 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.e8566bd9-f201-4224-97c3-696500870d0c Sep 07 13:53:02 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:02 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3df95a35-625c-4945-8c79-452113267a4a tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.e8566bd9-f201-4224-97c3-696500870d0c" returned: 0 in 0.277s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3df95a35-625c-4945-8c79-452113267a4a tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:02 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.info Sep 07 13:53:02 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-bda50402-85bd-4def-9954-88cf6715e08f tempest-VolumesSnapshotListTestJSON-1450347923 None] Acquiring lock "cinder-21207801-ad72-4727-ae99-1074968d1e19-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-bda50402-85bd-4def-9954-88cf6715e08f tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "cinder-21207801-ad72-4727-ae99-1074968d1e19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-bda50402-85bd-4def-9954-88cf6715e08f tempest-VolumesSnapshotListTestJSON-1450347923 None] Acquiring lock "cinder-quobyte-086d70a2-41a3-4454-abd2-8b70f8c1b733" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-bda50402-85bd-4def-9954-88cf6715e08f tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "cinder-quobyte-086d70a2-41a3-4454-abd2-8b70f8c1b733" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-bda50402-85bd-4def-9954-88cf6715e08f tempest-VolumesSnapshotListTestJSON-1450347923 None] Acquiring lock "cinder-quobyte-21207801-ad72-4727-ae99-1074968d1e19" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-bda50402-85bd-4def-9954-88cf6715e08f tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "cinder-quobyte-21207801-ad72-4727-ae99-1074968d1e19" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-bda50402-85bd-4def-9954-88cf6715e08f tempest-VolumesSnapshotListTestJSON-1450347923 None] Deleting offline snapshot 21207801-ad72-4727-ae99-1074968d1e19 of volume 086d70a2-41a3-4454-abd2-8b70f8c1b733 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:53:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-bda50402-85bd-4def-9954-88cf6715e08f tempest-VolumesSnapshotListTestJSON-1450347923 None] snapshot_file for this snap is: volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.21207801-ad72-4727-ae99-1074968d1e19 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:53:02 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3795f408-ff18-4518-bd25-63b3317389a8]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bda50402-85bd-4def-9954-88cf6715e08f tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.21207801-ad72-4727-ae99-1074968d1e19 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:02 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3df95a35-625c-4945-8c79-452113267a4a tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.info" returned: 0 in 0.296s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:02 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-3df95a35-625c-4945-8c79-452113267a4a tempest-VolumesSnapshotTestJSON-854675887 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.info is being set with open permissions: ugo+rw Sep 07 13:53:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3df95a35-625c-4945-8c79-452113267a4a tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:02 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.info Sep 07 13:53:02 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:02 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.21207801-ad72-4727-ae99-1074968d1e19 Sep 07 13:53:02 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:03 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3df95a35-625c-4945-8c79-452113267a4a tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.info" returned: 0 in 0.282s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3df95a35-625c-4945-8c79-452113267a4a tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.157s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:03 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-3df95a35-625c-4945-8c79-452113267a4a tempest-VolumesSnapshotTestJSON-854675887 None] Create snapshot completed successfully Sep 07 13:53:03 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bda50402-85bd-4def-9954-88cf6715e08f tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.21207801-ad72-4727-ae99-1074968d1e19" returned: 0 in 0.439s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:03 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-bda50402-85bd-4def-9954-88cf6715e08f tempest-VolumesSnapshotListTestJSON-1450347923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-086d70a2-41a3-4454-abd2-8b70f8c1b733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:53:03 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6931ab19-4d20-4246-9e69-59b115feb4ba]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bda50402-85bd-4def-9954-88cf6715e08f tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:03 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b Sep 07 13:53:03 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:03 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bda50402-85bd-4def-9954-88cf6715e08f tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b" returned: 0 in 0.387s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:03 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-bda50402-85bd-4def-9954-88cf6715e08f tempest-VolumesSnapshotListTestJSON-1450347923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-086d70a2-41a3-4454-abd2-8b70f8c1b733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:53:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bda50402-85bd-4def-9954-88cf6715e08f tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.21207801-ad72-4727-ae99-1074968d1e19 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:03 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.21207801-ad72-4727-ae99-1074968d1e19 Sep 07 13:53:03 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:04 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bda50402-85bd-4def-9954-88cf6715e08f tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.21207801-ad72-4727-ae99-1074968d1e19" returned: 0 in 0.623s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bda50402-85bd-4def-9954-88cf6715e08f tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.21207801-ad72-4727-ae99-1074968d1e19 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:04 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.21207801-ad72-4727-ae99-1074968d1e19 Sep 07 13:53:04 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:04 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bda50402-85bd-4def-9954-88cf6715e08f tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.21207801-ad72-4727-ae99-1074968d1e19" returned: 0 in 0.333s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-bda50402-85bd-4def-9954-88cf6715e08f tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "cinder-quobyte-21207801-ad72-4727-ae99-1074968d1e19" released by "_delete_snapshot" :: held 1.931s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-bda50402-85bd-4def-9954-88cf6715e08f tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "cinder-quobyte-086d70a2-41a3-4454-abd2-8b70f8c1b733" released by "delete_snapshot" :: held 1.968s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:04 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-bda50402-85bd-4def-9954-88cf6715e08f tempest-VolumesSnapshotListTestJSON-1450347923 None] Created reservations ['7e93d458-6f2f-4fe3-afce-f75f9e015ae4', 'dc1ad7f4-ae62-4b06-a591-8367a8bb911b', 'ed9cef2f-db79-4174-a6d9-315012c4edc1', '8f826bb8-8399-4ab2-8fc5-3b00a192423c'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:53:04 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:53:04 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-bda50402-85bd-4def-9954-88cf6715e08f tempest-VolumesSnapshotListTestJSON-1450347923 None] Delete snapshot completed successfully. Sep 07 13:53:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-bda50402-85bd-4def-9954-88cf6715e08f tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "cinder-21207801-ad72-4727-ae99-1074968d1e19-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Flow 'volume_create_manager' (04d50b67-3f33-4c9e-a638-6334a95b11f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:53:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bbedfdb-a054-4e82-8c36-6c53ffb10522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bbedfdb-a054-4e82-8c36-6c53ffb10522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1046834975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e86009f7-7816-40e2-901f-31fcab28c7ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a6114a89664e8e9a0642fafa03f56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e8566bd9-f201-4224-97c3-696500870d0c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:53:05Z,use_quota=True,user_id='356e3e0715e94982968ab2c31ecd7161',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220a8a58-d2fd-464d-bbd9-2163fd8996b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220a8a58-d2fd-464d-bbd9-2163fd8996b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eafbc1b0-2191-40ef-b124-18b538ccfc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eafbc1b0-2191-40ef-b124-18b538ccfc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e86009f7-7816-40e2-901f-31fcab28c7ae', 'volume_name': 'volume-e86009f7-7816-40e2-901f-31fcab28c7ae', 'volume_size': 1, 'snapshot_id': 'e8566bd9-f201-4224-97c3-696500870d0c'}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23e5655-23fd-473c-b075-57af7280ad8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23e5655-23fd-473c-b075-57af7280ad8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d295fb76-35a3-4ccf-b8a4-51ad46fc9ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:04 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Volume e86009f7-7816-40e2-901f-31fcab28c7ae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e86009f7-7816-40e2-901f-31fcab28c7ae', 'volume_size': 1, 'snapshot_id': 'e8566bd9-f201-4224-97c3-696500870d0c'} Sep 07 13:53:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "cinder-quobyte-e8566bd9-f201-4224-97c3-696500870d0c-e86009f7-7816-40e2-901f-31fcab28c7ae" by "_create_volume_from_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-e8566bd9-f201-4224-97c3-696500870d0c-e86009f7-7816-40e2-901f-31fcab28c7ae" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Creating volume e86009f7-7816-40e2-901f-31fcab28c7ae from snapshot e8566bd9-f201-4224-97c3-696500870d0c {{(pid=87571) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "cinder-quobyte-e86009f7-7816-40e2-901f-31fcab28c7ae" by "_copy_volume_from_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-e86009f7-7816-40e2-901f-31fcab28c7ae" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] snapshot: e8566bd9-f201-4224-97c3-696500870d0c, volume: e86009f7-7816-40e2-901f-31fcab28c7ae, {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cd5bd0-5686-4a6f-b41c-92e63e448910]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.e8566bd9-f201-4224-97c3-696500870d0c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:05 devstack sudo[99076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.e8566bd9-f201-4224-97c3-696500870d0c Sep 07 13:53:05 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:05 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.e8566bd9-f201-4224-97c3-696500870d0c" returned: 0 in 0.358s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9944ca-ab0a-4706-9cbc-31c69d87b4d8]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:05 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6 Sep 07 13:53:05 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:05 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6" returned: 0 in 0.370s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6 {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Creating direct copy from snapshot {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG cinder.utils [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Path /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e86009f7-7816-40e2-901f-31fcab28c7ae not found in is_blk_device check {{(pid=87571) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e86009f7-7816-40e2-901f-31fcab28c7ae {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:05 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e86009f7-7816-40e2-901f-31fcab28c7ae Sep 07 13:53:05 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cb50f8e6-de67-425e-8457-87b2af49eb2d tempest-VolumesSnapshotListTestJSON-1450347923 None] Acquiring lock "cinder-f140e27d-fde7-48c1-9963-454c6dd8ea5b-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cb50f8e6-de67-425e-8457-87b2af49eb2d tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "cinder-f140e27d-fde7-48c1-9963-454c6dd8ea5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cb50f8e6-de67-425e-8457-87b2af49eb2d tempest-VolumesSnapshotListTestJSON-1450347923 None] Acquiring lock "cinder-quobyte-086d70a2-41a3-4454-abd2-8b70f8c1b733" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cb50f8e6-de67-425e-8457-87b2af49eb2d tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "cinder-quobyte-086d70a2-41a3-4454-abd2-8b70f8c1b733" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cb50f8e6-de67-425e-8457-87b2af49eb2d tempest-VolumesSnapshotListTestJSON-1450347923 None] Acquiring lock "cinder-quobyte-f140e27d-fde7-48c1-9963-454c6dd8ea5b" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cb50f8e6-de67-425e-8457-87b2af49eb2d tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "cinder-quobyte-f140e27d-fde7-48c1-9963-454c6dd8ea5b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-cb50f8e6-de67-425e-8457-87b2af49eb2d tempest-VolumesSnapshotListTestJSON-1450347923 None] Deleting offline snapshot f140e27d-fde7-48c1-9963-454c6dd8ea5b of volume 086d70a2-41a3-4454-abd2-8b70f8c1b733 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-cb50f8e6-de67-425e-8457-87b2af49eb2d tempest-VolumesSnapshotListTestJSON-1450347923 None] snapshot_file for this snap is: volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[71550e48-12c7-4344-9897-a90b995e37a4]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cb50f8e6-de67-425e-8457-87b2af49eb2d tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:06 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b Sep 07 13:53:06 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:06 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cb50f8e6-de67-425e-8457-87b2af49eb2d tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b" returned: 0 in 0.500s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-cb50f8e6-de67-425e-8457-87b2af49eb2d tempest-VolumesSnapshotListTestJSON-1450347923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-086d70a2-41a3-4454-abd2-8b70f8c1b733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:53:06 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c9bd34-60bd-4e63-92d8-f3a48f0c9522]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cb50f8e6-de67-425e-8457-87b2af49eb2d tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:06 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae Sep 07 13:53:06 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:07 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cb50f8e6-de67-425e-8457-87b2af49eb2d tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae" returned: 0 in 0.938s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-cb50f8e6-de67-425e-8457-87b2af49eb2d tempest-VolumesSnapshotListTestJSON-1450347923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-086d70a2-41a3-4454-abd2-8b70f8c1b733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:53:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cb50f8e6-de67-425e-8457-87b2af49eb2d tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:07 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b Sep 07 13:53:07 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:08 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cb50f8e6-de67-425e-8457-87b2af49eb2d tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b" returned: 0 in 0.865s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cb50f8e6-de67-425e-8457-87b2af49eb2d tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:08 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b Sep 07 13:53:08 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:09 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cb50f8e6-de67-425e-8457-87b2af49eb2d tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.f140e27d-fde7-48c1-9963-454c6dd8ea5b" returned: 0 in 0.984s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cb50f8e6-de67-425e-8457-87b2af49eb2d tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "cinder-quobyte-f140e27d-fde7-48c1-9963-454c6dd8ea5b" released by "_delete_snapshot" :: held 3.469s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cb50f8e6-de67-425e-8457-87b2af49eb2d tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "cinder-quobyte-086d70a2-41a3-4454-abd2-8b70f8c1b733" released by "delete_snapshot" :: held 3.501s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:09 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-cb50f8e6-de67-425e-8457-87b2af49eb2d tempest-VolumesSnapshotListTestJSON-1450347923 None] Created reservations ['dd6e1404-c87a-43b2-b46c-a8daca2e2191', '3969d17c-1be4-4b26-9d98-ebe785ef3fb3', '302255a3-8852-4a5e-b738-7a8dd3c60c3b', '47419142-6908-4d17-8ea5-d5e5fa40bf2e'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:53:09 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-cb50f8e6-de67-425e-8457-87b2af49eb2d tempest-VolumesSnapshotListTestJSON-1450347923 None] Delete snapshot completed successfully. Sep 07 13:53:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cb50f8e6-de67-425e-8457-87b2af49eb2d tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "cinder-f140e27d-fde7-48c1-9963-454c6dd8ea5b-delete_snapshot" released by "delete_snapshot" :: held 3.714s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:10 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e86009f7-7816-40e2-901f-31fcab28c7ae" returned: 0 in 4.457s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6, size 1024.00 MB, duration 4.46 sec, destination /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e86009f7-7816-40e2-901f-31fcab28c7ae {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:53:10 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Converted 1024.00 MB image at 229.72 MB/s Sep 07 13:53:10 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e86009f7-7816-40e2-901f-31fcab28c7ae is being set with open permissions: ugo+rw Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e86009f7-7816-40e2-901f-31fcab28c7ae {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:10 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e86009f7-7816-40e2-901f-31fcab28c7ae Sep 07 13:53:10 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b85aa564-7953-457b-b0ef-dbfd3645d773 tempest-VolumesSnapshotListTestJSON-1450347923 None] Acquiring lock "cinder-82a9bfe2-08fc-4e57-ab2a-d3d81c333aae-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b85aa564-7953-457b-b0ef-dbfd3645d773 tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "cinder-82a9bfe2-08fc-4e57-ab2a-d3d81c333aae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b85aa564-7953-457b-b0ef-dbfd3645d773 tempest-VolumesSnapshotListTestJSON-1450347923 None] Acquiring lock "cinder-quobyte-086d70a2-41a3-4454-abd2-8b70f8c1b733" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b85aa564-7953-457b-b0ef-dbfd3645d773 tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "cinder-quobyte-086d70a2-41a3-4454-abd2-8b70f8c1b733" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b85aa564-7953-457b-b0ef-dbfd3645d773 tempest-VolumesSnapshotListTestJSON-1450347923 None] Acquiring lock "cinder-quobyte-82a9bfe2-08fc-4e57-ab2a-d3d81c333aae" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b85aa564-7953-457b-b0ef-dbfd3645d773 tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "cinder-quobyte-82a9bfe2-08fc-4e57-ab2a-d3d81c333aae" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-b85aa564-7953-457b-b0ef-dbfd3645d773 tempest-VolumesSnapshotListTestJSON-1450347923 None] Deleting offline snapshot 82a9bfe2-08fc-4e57-ab2a-d3d81c333aae of volume 086d70a2-41a3-4454-abd2-8b70f8c1b733 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-b85aa564-7953-457b-b0ef-dbfd3645d773 tempest-VolumesSnapshotListTestJSON-1450347923 None] snapshot_file for this snap is: volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adc6dd3-dbe6-40b1-903d-52620770ebf2]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b85aa564-7953-457b-b0ef-dbfd3645d773 tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:10 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e86009f7-7816-40e2-901f-31fcab28c7ae" returned: 0 in 0.277s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:10 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae Sep 07 13:53:10 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-e86009f7-7816-40e2-901f-31fcab28c7ae" released by "_copy_volume_from_snapshot" :: held 5.550s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-e8566bd9-f201-4224-97c3-696500870d0c-e86009f7-7816-40e2-901f-31fcab28c7ae" released by "_create_volume_from_snapshot" :: held 5.628s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.647s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d295fb76-35a3-4ccf-b8a4-51ad46fc9ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e86009f7-7816-40e2-901f-31fcab28c7ae', 'volume_size': 1, 'snapshot_id': 'e8566bd9-f201-4224-97c3-696500870d0c'}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd067e09-de49-4647-82c4-2e1d139ec83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:10 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Volume volume-e86009f7-7816-40e2-901f-31fcab28c7ae (e86009f7-7816-40e2-901f-31fcab28c7ae): created successfully Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd067e09-de49-4647-82c4-2e1d139ec83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Flow 'volume_create_manager' (04d50b67-3f33-4c9e-a638-6334a95b11f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:53:10 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-75cec544-59ea-4a30-a0e8-980c83c2f609 tempest-VolumesSnapshotTestJSON-854675887 None] Created volume successfully. Sep 07 13:53:10 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b85aa564-7953-457b-b0ef-dbfd3645d773 tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae" returned: 0 in 0.424s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-b85aa564-7953-457b-b0ef-dbfd3645d773 tempest-VolumesSnapshotListTestJSON-1450347923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-086d70a2-41a3-4454-abd2-8b70f8c1b733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c979d1c-64a1-442f-b05c-067ca00a6c6f]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b85aa564-7953-457b-b0ef-dbfd3645d773 tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:11 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733 Sep 07 13:53:11 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:11 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b85aa564-7953-457b-b0ef-dbfd3645d773 tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733" returned: 0 in 0.381s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b85aa564-7953-457b-b0ef-dbfd3645d773 tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:11 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae Sep 07 13:53:11 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ceec0e60-add5-45ac-9c51-96a11d64c59c tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "cinder-e86009f7-7816-40e2-901f-31fcab28c7ae-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ceec0e60-add5-45ac-9c51-96a11d64c59c tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-e86009f7-7816-40e2-901f-31fcab28c7ae-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ceec0e60-add5-45ac-9c51-96a11d64c59c tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "cinder-quobyte-e86009f7-7816-40e2-901f-31fcab28c7ae" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ceec0e60-add5-45ac-9c51-96a11d64c59c tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-e86009f7-7816-40e2-901f-31fcab28c7ae" acquired by "delete_volume" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:11 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc7cebd-3d12-41d1-a05f-50490067694f]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ceec0e60-add5-45ac-9c51-96a11d64c59c tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e86009f7-7816-40e2-901f-31fcab28c7ae {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:11 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b85aa564-7953-457b-b0ef-dbfd3645d773 tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae" returned: 0 in 0.379s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b85aa564-7953-457b-b0ef-dbfd3645d773 tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:11 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae Sep 07 13:53:11 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:11 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e86009f7-7816-40e2-901f-31fcab28c7ae Sep 07 13:53:11 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:11 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b85aa564-7953-457b-b0ef-dbfd3645d773 tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733.82a9bfe2-08fc-4e57-ab2a-d3d81c333aae" returned: 0 in 0.260s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b85aa564-7953-457b-b0ef-dbfd3645d773 tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "cinder-quobyte-82a9bfe2-08fc-4e57-ab2a-d3d81c333aae" released by "_delete_snapshot" :: held 1.580s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:11 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ceec0e60-add5-45ac-9c51-96a11d64c59c tempest-VolumesSnapshotTestJSON-854675887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e86009f7-7816-40e2-901f-31fcab28c7ae" returned: 0 in 0.398s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ceec0e60-add5-45ac-9c51-96a11d64c59c tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e86009f7-7816-40e2-901f-31fcab28c7ae {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b85aa564-7953-457b-b0ef-dbfd3645d773 tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "cinder-quobyte-086d70a2-41a3-4454-abd2-8b70f8c1b733" released by "delete_snapshot" :: held 1.616s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:11 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e86009f7-7816-40e2-901f-31fcab28c7ae Sep 07 13:53:11 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-b85aa564-7953-457b-b0ef-dbfd3645d773 tempest-VolumesSnapshotListTestJSON-1450347923 None] Created reservations ['a54738c1-cbba-4984-8b49-802581b905c7', '2eb8c20a-bf79-4364-bd55-1e0126d3b8ba', 'fe8417c9-cb98-4c67-b2c0-2a1d42b40746', 'b0994d41-5808-4d45-be8d-cf82872e4ffa'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:53:12 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-b85aa564-7953-457b-b0ef-dbfd3645d773 tempest-VolumesSnapshotListTestJSON-1450347923 None] Delete snapshot completed successfully. Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b85aa564-7953-457b-b0ef-dbfd3645d773 tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "cinder-82a9bfe2-08fc-4e57-ab2a-d3d81c333aae-delete_snapshot" released by "delete_snapshot" :: held 1.776s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:12 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ceec0e60-add5-45ac-9c51-96a11d64c59c tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e86009f7-7816-40e2-901f-31fcab28c7ae" returned: 0 in 0.245s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ceec0e60-add5-45ac-9c51-96a11d64c59c tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-e86009f7-7816-40e2-901f-31fcab28c7ae" released by "delete_volume" :: held 0.680s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-ceec0e60-add5-45ac-9c51-96a11d64c59c tempest-VolumesSnapshotTestJSON-854675887 None] Created reservations ['9e63eeea-5c3a-47cc-bdb6-3adf66e7083f', '07b5343c-dba8-47b4-afc8-5deb58b9cbed', '1c1af2a6-279d-4803-b8c0-8c66cb327761', '606ab5f9-a196-42cc-a70e-14604ecd0e13'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ceec0e60-add5-45ac-9c51-96a11d64c59c tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ceec0e60-add5-45ac-9c51-96a11d64c59c tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ceec0e60-add5-45ac-9c51-96a11d64c59c tempest-VolumesSnapshotTestJSON-854675887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ceec0e60-add5-45ac-9c51-96a11d64c59c tempest-VolumesSnapshotTestJSON-854675887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ceec0e60-add5-45ac-9c51-96a11d64c59c tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ceec0e60-add5-45ac-9c51-96a11d64c59c tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:12 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:53:12 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8877aa83-eaa4-4af9-b40b-55b0ac7108d9 tempest-VolumesSnapshotListTestJSON-1450347923 None] Acquiring lock "cinder-086d70a2-41a3-4454-abd2-8b70f8c1b733-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:12 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ceec0e60-add5-45ac-9c51-96a11d64c59c tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.246s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-ceec0e60-add5-45ac-9c51-96a11d64c59c tempest-VolumesSnapshotTestJSON-854675887 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8877aa83-eaa4-4af9-b40b-55b0ac7108d9 tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "cinder-086d70a2-41a3-4454-abd2-8b70f8c1b733-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:12 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-ceec0e60-add5-45ac-9c51-96a11d64c59c tempest-VolumesSnapshotTestJSON-854675887 None] Deleted volume successfully. Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ceec0e60-add5-45ac-9c51-96a11d64c59c tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-e86009f7-7816-40e2-901f-31fcab28c7ae-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8877aa83-eaa4-4af9-b40b-55b0ac7108d9 tempest-VolumesSnapshotListTestJSON-1450347923 None] Acquiring lock "cinder-quobyte-086d70a2-41a3-4454-abd2-8b70f8c1b733" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8877aa83-eaa4-4af9-b40b-55b0ac7108d9 tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "cinder-quobyte-086d70a2-41a3-4454-abd2-8b70f8c1b733" acquired by "delete_volume" :: waited 0.016s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80da930-2bac-4721-9542-0bcc64e69f62]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8877aa83-eaa4-4af9-b40b-55b0ac7108d9 tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8dc2d8fc-6dc2-4f4f-a1bb-9a8f11d56dbc tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "cinder-e8566bd9-f201-4224-97c3-696500870d0c-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8dc2d8fc-6dc2-4f4f-a1bb-9a8f11d56dbc tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-e8566bd9-f201-4224-97c3-696500870d0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8dc2d8fc-6dc2-4f4f-a1bb-9a8f11d56dbc tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "cinder-quobyte-094bcf72-d826-4a4b-8b4c-c244a219dfe6" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8dc2d8fc-6dc2-4f4f-a1bb-9a8f11d56dbc tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-094bcf72-d826-4a4b-8b4c-c244a219dfe6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8dc2d8fc-6dc2-4f4f-a1bb-9a8f11d56dbc tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "cinder-quobyte-e8566bd9-f201-4224-97c3-696500870d0c" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8dc2d8fc-6dc2-4f4f-a1bb-9a8f11d56dbc tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-e8566bd9-f201-4224-97c3-696500870d0c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-8dc2d8fc-6dc2-4f4f-a1bb-9a8f11d56dbc tempest-VolumesSnapshotTestJSON-854675887 None] Deleting offline snapshot e8566bd9-f201-4224-97c3-696500870d0c of volume 094bcf72-d826-4a4b-8b4c-c244a219dfe6 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-8dc2d8fc-6dc2-4f4f-a1bb-9a8f11d56dbc tempest-VolumesSnapshotTestJSON-854675887 None] snapshot_file for this snap is: volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.e8566bd9-f201-4224-97c3-696500870d0c {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae19e75-ccac-4217-b1f2-b70cda032a21]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8dc2d8fc-6dc2-4f4f-a1bb-9a8f11d56dbc tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.e8566bd9-f201-4224-97c3-696500870d0c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:12 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733 Sep 07 13:53:12 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:12 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.e8566bd9-f201-4224-97c3-696500870d0c Sep 07 13:53:12 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:13 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8877aa83-eaa4-4af9-b40b-55b0ac7108d9 tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733" returned: 0 in 0.372s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8877aa83-eaa4-4af9-b40b-55b0ac7108d9 tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:13 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733 Sep 07 13:53:13 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:13 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8dc2d8fc-6dc2-4f4f-a1bb-9a8f11d56dbc tempest-VolumesSnapshotTestJSON-854675887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.e8566bd9-f201-4224-97c3-696500870d0c" returned: 0 in 0.369s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:13 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-8dc2d8fc-6dc2-4f4f-a1bb-9a8f11d56dbc tempest-VolumesSnapshotTestJSON-854675887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:53:13 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5600e4d-212a-4c5c-9b64-ab9fd8167a72]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8dc2d8fc-6dc2-4f4f-a1bb-9a8f11d56dbc tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:13 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6 Sep 07 13:53:13 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:13 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8877aa83-eaa4-4af9-b40b-55b0ac7108d9 tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-086d70a2-41a3-4454-abd2-8b70f8c1b733" returned: 0 in 0.263s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8877aa83-eaa4-4af9-b40b-55b0ac7108d9 tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "cinder-quobyte-086d70a2-41a3-4454-abd2-8b70f8c1b733" released by "delete_volume" :: held 0.690s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:13 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-8877aa83-eaa4-4af9-b40b-55b0ac7108d9 tempest-VolumesSnapshotListTestJSON-1450347923 None] Created reservations ['59def73e-848c-4418-9dbb-a4fe8aafc455', '8d1d5550-6fcb-41f3-b0e6-0cddcc4839fb', '250eb86d-ddb2-4718-ab9b-b872b457ff4e', '3787144f-e289-4476-bd7f-fb6d08d7f3be'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:53:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8877aa83-eaa4-4af9-b40b-55b0ac7108d9 tempest-VolumesSnapshotListTestJSON-1450347923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8877aa83-eaa4-4af9-b40b-55b0ac7108d9 tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:13 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8877aa83-eaa4-4af9-b40b-55b0ac7108d9 tempest-VolumesSnapshotListTestJSON-1450347923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:53:13 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8877aa83-eaa4-4af9-b40b-55b0ac7108d9 tempest-VolumesSnapshotListTestJSON-1450347923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:53:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8877aa83-eaa4-4af9-b40b-55b0ac7108d9 tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8877aa83-eaa4-4af9-b40b-55b0ac7108d9 tempest-VolumesSnapshotListTestJSON-1450347923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:13 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:53:13 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:13 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8877aa83-eaa4-4af9-b40b-55b0ac7108d9 tempest-VolumesSnapshotListTestJSON-1450347923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.259s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:13 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-8877aa83-eaa4-4af9-b40b-55b0ac7108d9 tempest-VolumesSnapshotListTestJSON-1450347923 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:53:13 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-8877aa83-eaa4-4af9-b40b-55b0ac7108d9 tempest-VolumesSnapshotListTestJSON-1450347923 None] Deleted volume successfully. Sep 07 13:53:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8877aa83-eaa4-4af9-b40b-55b0ac7108d9 tempest-VolumesSnapshotListTestJSON-1450347923 None] Lock "cinder-086d70a2-41a3-4454-abd2-8b70f8c1b733-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:13 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8dc2d8fc-6dc2-4f4f-a1bb-9a8f11d56dbc tempest-VolumesSnapshotTestJSON-854675887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6" returned: 0 in 0.582s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8dc2d8fc-6dc2-4f4f-a1bb-9a8f11d56dbc tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.e8566bd9-f201-4224-97c3-696500870d0c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:13 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.e8566bd9-f201-4224-97c3-696500870d0c Sep 07 13:53:13 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:14 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8dc2d8fc-6dc2-4f4f-a1bb-9a8f11d56dbc tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.e8566bd9-f201-4224-97c3-696500870d0c" returned: 0 in 0.366s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8dc2d8fc-6dc2-4f4f-a1bb-9a8f11d56dbc tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.e8566bd9-f201-4224-97c3-696500870d0c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:14 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.e8566bd9-f201-4224-97c3-696500870d0c Sep 07 13:53:14 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:14 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8dc2d8fc-6dc2-4f4f-a1bb-9a8f11d56dbc tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6.e8566bd9-f201-4224-97c3-696500870d0c" returned: 0 in 0.297s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:14 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8dc2d8fc-6dc2-4f4f-a1bb-9a8f11d56dbc tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-e8566bd9-f201-4224-97c3-696500870d0c" released by "_delete_snapshot" :: held 1.737s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:14 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8dc2d8fc-6dc2-4f4f-a1bb-9a8f11d56dbc tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-094bcf72-d826-4a4b-8b4c-c244a219dfe6" released by "delete_snapshot" :: held 1.766s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:14 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-8dc2d8fc-6dc2-4f4f-a1bb-9a8f11d56dbc tempest-VolumesSnapshotTestJSON-854675887 None] Created reservations ['7268ca16-fbd0-4890-8563-ae4673c6b4a8', '29f681cc-09ec-4749-90af-7f4ca12b77e5', '1bc742dc-b696-42aa-9a64-46fe20300f21', '5063fc66-5c71-4b21-9a79-f0e7be791d92'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:53:14 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-8dc2d8fc-6dc2-4f4f-a1bb-9a8f11d56dbc tempest-VolumesSnapshotTestJSON-854675887 None] Delete snapshot completed successfully. Sep 07 13:53:14 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8dc2d8fc-6dc2-4f4f-a1bb-9a8f11d56dbc tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-e8566bd9-f201-4224-97c3-696500870d0c-delete_snapshot" released by "delete_snapshot" :: held 1.995s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dd419c92-0241-4872-ad76-cb7b397032ed tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "cinder-094bcf72-d826-4a4b-8b4c-c244a219dfe6-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dd419c92-0241-4872-ad76-cb7b397032ed tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-094bcf72-d826-4a4b-8b4c-c244a219dfe6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dd419c92-0241-4872-ad76-cb7b397032ed tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "cinder-quobyte-094bcf72-d826-4a4b-8b4c-c244a219dfe6" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dd419c92-0241-4872-ad76-cb7b397032ed tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-094bcf72-d826-4a4b-8b4c-c244a219dfe6" acquired by "delete_volume" :: waited 0.019s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:15 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[384b1179-2da2-4df1-91da-457a6b330111]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dd419c92-0241-4872-ad76-cb7b397032ed tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:15 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6 Sep 07 13:53:15 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:15 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dd419c92-0241-4872-ad76-cb7b397032ed tempest-VolumesSnapshotTestJSON-854675887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6" returned: 0 in 0.679s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dd419c92-0241-4872-ad76-cb7b397032ed tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:16 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6 Sep 07 13:53:16 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Flow 'volume_create_manager' (a2fe96df-7722-428b-b20d-9e4a513d45ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8993976-4316-4b3e-93e9-97ad077ca66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=110,cinder:UPDATE=107,cinder:DELETE=8,cinder:INSERT=18 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8993976-4316-4b3e-93e9-97ad077ca66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-701755470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b4e4b76-4587-4f38-aa1c-b0f8e3548c36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6147a7e49abf47eda252408fb0741f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:53:16Z,use_quota=True,user_id='34aacec7b8284f38a711d350e4e44e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93d4cd8-da82-4fd4-9911-3dbc4a7a2ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93d4cd8-da82-4fd4-9911-3dbc4a7a2ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39542649-f1e7-45bd-b81d-482c1ad41a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39542649-f1e7-45bd-b81d-482c1ad41a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b4e4b76-4587-4f38-aa1c-b0f8e3548c36', 'volume_name': 'volume-6b4e4b76-4587-4f38-aa1c-b0f8e3548c36', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade7d266-fcb3-48f1-9bc1-feeb656c2802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade7d266-fcb3-48f1-9bc1-feeb656c2802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78c37fd-e6bc-404e-9d5e-9e433afc5509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:16 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Volume 6b4e4b76-4587-4f38-aa1c-b0f8e3548c36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b4e4b76-4587-4f38-aa1c-b0f8e3548c36', 'volume_size': 1} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-701755470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b4e4b76-4587-4f38-aa1c-b0f8e3548c36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6147a7e49abf47eda252408fb0741f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:53:16Z,use_quota=True,user_id='34aacec7b8284f38a711d350e4e44e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Creating volume 6b4e4b76-4587-4f38-aa1c-b0f8e3548c36 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:53:16 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6b4e4b76-4587-4f38-aa1c-b0f8e3548c36 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:16 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6b4e4b76-4587-4f38-aa1c-b0f8e3548c36 1073741824 Sep 07 13:53:16 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:16 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dd419c92-0241-4872-ad76-cb7b397032ed tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-094bcf72-d826-4a4b-8b4c-c244a219dfe6" returned: 0 in 0.369s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dd419c92-0241-4872-ad76-cb7b397032ed tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-094bcf72-d826-4a4b-8b4c-c244a219dfe6" released by "delete_volume" :: held 1.132s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:UPDATE=98,cinder:SELECT=103,cinder:INSERT=36,cinder:DELETE=9 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-dd419c92-0241-4872-ad76-cb7b397032ed tempest-VolumesSnapshotTestJSON-854675887 None] Created reservations ['6bfefaf0-f3b2-49db-8730-ebce5b36172c', '82375481-cc2b-4da8-925d-b7beaa2334ab', 'a6c08365-ed7f-4609-bc41-5491bae017d0', 'd6b4d46a-cc50-4be7-a95a-c8e371339259'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-dd419c92-0241-4872-ad76-cb7b397032ed tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-dd419c92-0241-4872-ad76-cb7b397032ed tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-dd419c92-0241-4872-ad76-cb7b397032ed tempest-VolumesSnapshotTestJSON-854675887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-dd419c92-0241-4872-ad76-cb7b397032ed tempest-VolumesSnapshotTestJSON-854675887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-dd419c92-0241-4872-ad76-cb7b397032ed tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dd419c92-0241-4872-ad76-cb7b397032ed tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:16 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:53:16 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:16 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-46127797-24ad-4267-bc76-49ff0fb9bc57 req-2c95956a-d1cd-45a2-b6bf-62c5b509ae05 tempest-TestShelveInstance-1626297668 None] Terminate volume connection completed successfully. Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-46127797-24ad-4267-bc76-49ff0fb9bc57 req-2c95956a-d1cd-45a2-b6bf-62c5b509ae05 tempest-TestShelveInstance-1626297668 None] Deleting attachment 28a5b43a-e449-4d79-95c4-613859a6e4c9. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:53:16 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dd419c92-0241-4872-ad76-cb7b397032ed tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.440s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:16 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-dd419c92-0241-4872-ad76-cb7b397032ed tempest-VolumesSnapshotTestJSON-854675887 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:53:16 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6b4e4b76-4587-4f38-aa1c-b0f8e3548c36 1073741824" returned: 0 in 0.803s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:17 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-dd419c92-0241-4872-ad76-cb7b397032ed tempest-VolumesSnapshotTestJSON-854675887 None] Deleted volume successfully. Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dd419c92-0241-4872-ad76-cb7b397032ed tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-094bcf72-d826-4a4b-8b4c-c244a219dfe6-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6b4e4b76-4587-4f38-aa1c-b0f8e3548c36 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:17 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6b4e4b76-4587-4f38-aa1c-b0f8e3548c36 Sep 07 13:53:17 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-46127797-24ad-4267-bc76-49ff0fb9bc57 req-323175c8-4643-40fe-bd58-bd63ccfefc8d tempest-TestShelveInstance-1626297668 None] Acquiring lock "cinder-664cac84-7c2e-4092-a58f-4219c6065d08-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-46127797-24ad-4267-bc76-49ff0fb9bc57 req-323175c8-4643-40fe-bd58-bd63ccfefc8d tempest-TestShelveInstance-1626297668 None] Lock "cinder-664cac84-7c2e-4092-a58f-4219c6065d08-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-46127797-24ad-4267-bc76-49ff0fb9bc57 req-323175c8-4643-40fe-bd58-bd63ccfefc8d tempest-TestShelveInstance-1626297668 None] Acquiring lock "cinder-quobyte-664cac84-7c2e-4092-a58f-4219c6065d08" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-46127797-24ad-4267-bc76-49ff0fb9bc57 req-323175c8-4643-40fe-bd58-bd63ccfefc8d tempest-TestShelveInstance-1626297668 None] Lock "cinder-quobyte-664cac84-7c2e-4092-a58f-4219c6065d08" acquired by "delete_volume" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5eaf933-157f-4a88-8670-3795200c9b6c]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-46127797-24ad-4267-bc76-49ff0fb9bc57 req-323175c8-4643-40fe-bd58-bd63ccfefc8d tempest-TestShelveInstance-1626297668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-664cac84-7c2e-4092-a58f-4219c6065d08 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:17 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:17 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-664cac84-7c2e-4092-a58f-4219c6065d08 Sep 07 13:53:17 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6b4e4b76-4587-4f38-aa1c-b0f8e3548c36" returned: 0 in 0.326s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78c37fd-e6bc-404e-9d5e-9e433afc5509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b4e4b76-4587-4f38-aa1c-b0f8e3548c36', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49b1f4c-00b5-4422-bf7d-58bea85cae9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:17 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Volume volume-6b4e4b76-4587-4f38-aa1c-b0f8e3548c36 (6b4e4b76-4587-4f38-aa1c-b0f8e3548c36): created successfully Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49b1f4c-00b5-4422-bf7d-58bea85cae9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Flow 'volume_create_manager' (a2fe96df-7722-428b-b20d-9e4a513d45ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:53:17 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-f87f1a21-2db4-4dc5-b5d8-94c4e52d29e3 tempest-AttachVolumeNegativeTest-470973352 None] Created volume successfully. Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8036d784-1ed3-40cc-9ff6-b8487af8070e tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "cinder-cee4f461-c874-42e3-b912-a88cf645427f-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8036d784-1ed3-40cc-9ff6-b8487af8070e tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-cee4f461-c874-42e3-b912-a88cf645427f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8036d784-1ed3-40cc-9ff6-b8487af8070e tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "cinder-quobyte-cee4f461-c874-42e3-b912-a88cf645427f" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8036d784-1ed3-40cc-9ff6-b8487af8070e tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-cee4f461-c874-42e3-b912-a88cf645427f" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4e1ba9-6c24-47d1-a3ee-1db04692e865]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8036d784-1ed3-40cc-9ff6-b8487af8070e tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:17 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-46127797-24ad-4267-bc76-49ff0fb9bc57 req-323175c8-4643-40fe-bd58-bd63ccfefc8d tempest-TestShelveInstance-1626297668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-664cac84-7c2e-4092-a58f-4219c6065d08" returned: 0 in 0.536s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-46127797-24ad-4267-bc76-49ff0fb9bc57 req-323175c8-4643-40fe-bd58-bd63ccfefc8d tempest-TestShelveInstance-1626297668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-664cac84-7c2e-4092-a58f-4219c6065d08 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:17 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-664cac84-7c2e-4092-a58f-4219c6065d08 Sep 07 13:53:17 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:17 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f Sep 07 13:53:17 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:18 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-46127797-24ad-4267-bc76-49ff0fb9bc57 req-323175c8-4643-40fe-bd58-bd63ccfefc8d tempest-TestShelveInstance-1626297668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-664cac84-7c2e-4092-a58f-4219c6065d08" returned: 0 in 0.308s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-46127797-24ad-4267-bc76-49ff0fb9bc57 req-323175c8-4643-40fe-bd58-bd63ccfefc8d tempest-TestShelveInstance-1626297668 None] Lock "cinder-quobyte-664cac84-7c2e-4092-a58f-4219c6065d08" released by "delete_volume" :: held 0.897s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:18 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8036d784-1ed3-40cc-9ff6-b8487af8070e tempest-VolumesSnapshotTestJSON-854675887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f" returned: 0 in 0.454s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8036d784-1ed3-40cc-9ff6-b8487af8070e tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:18 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f Sep 07 13:53:18 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:18 devstack cinder-volume[87571]: DEBUG cinder.quota [req-46127797-24ad-4267-bc76-49ff0fb9bc57 req-323175c8-4643-40fe-bd58-bd63ccfefc8d tempest-TestShelveInstance-1626297668 None] Created reservations ['8e8827c8-0522-45b7-ad18-e7f77e5a90af', 'd5821a59-d066-44d7-9b1f-872e5025005a', 'ce5c7227-d766-49c7-a989-df47bf5f408c', '7a928805-5292-4ee6-8865-6f6731fe70b3'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:53:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-46127797-24ad-4267-bc76-49ff0fb9bc57 req-323175c8-4643-40fe-bd58-bd63ccfefc8d tempest-TestShelveInstance-1626297668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-46127797-24ad-4267-bc76-49ff0fb9bc57 req-323175c8-4643-40fe-bd58-bd63ccfefc8d tempest-TestShelveInstance-1626297668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [req-46127797-24ad-4267-bc76-49ff0fb9bc57 req-323175c8-4643-40fe-bd58-bd63ccfefc8d tempest-TestShelveInstance-1626297668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:53:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [req-46127797-24ad-4267-bc76-49ff0fb9bc57 req-323175c8-4643-40fe-bd58-bd63ccfefc8d tempest-TestShelveInstance-1626297668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:53:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-46127797-24ad-4267-bc76-49ff0fb9bc57 req-323175c8-4643-40fe-bd58-bd63ccfefc8d tempest-TestShelveInstance-1626297668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-46127797-24ad-4267-bc76-49ff0fb9bc57 req-323175c8-4643-40fe-bd58-bd63ccfefc8d tempest-TestShelveInstance-1626297668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:18 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:53:18 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:18 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8036d784-1ed3-40cc-9ff6-b8487af8070e tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cee4f461-c874-42e3-b912-a88cf645427f" returned: 0 in 0.439s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8036d784-1ed3-40cc-9ff6-b8487af8070e tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-quobyte-cee4f461-c874-42e3-b912-a88cf645427f" released by "delete_volume" :: held 0.981s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:18 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-8036d784-1ed3-40cc-9ff6-b8487af8070e tempest-VolumesSnapshotTestJSON-854675887 None] Created reservations ['4a6a513c-b39c-4143-954a-eb10ffc0b290', 'd3125f85-e03b-4aa9-81cd-0a28a45a3239', 'bbd89d61-3c86-4f0d-835f-3d2771372621', '44eea922-da81-4229-b6c0-8e683c7fb2d6'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:53:18 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [req-46127797-24ad-4267-bc76-49ff0fb9bc57 req-323175c8-4643-40fe-bd58-bd63ccfefc8d tempest-TestShelveInstance-1626297668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.380s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:18 devstack cinder-volume[87571]: DEBUG cinder.manager [req-46127797-24ad-4267-bc76-49ff0fb9bc57 req-323175c8-4643-40fe-bd58-bd63ccfefc8d tempest-TestShelveInstance-1626297668 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:53:18 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-46127797-24ad-4267-bc76-49ff0fb9bc57 req-323175c8-4643-40fe-bd58-bd63ccfefc8d tempest-TestShelveInstance-1626297668 None] Deleted volume successfully. Sep 07 13:53:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [req-46127797-24ad-4267-bc76-49ff0fb9bc57 req-323175c8-4643-40fe-bd58-bd63ccfefc8d tempest-TestShelveInstance-1626297668 None] Lock "cinder-664cac84-7c2e-4092-a58f-4219c6065d08-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8036d784-1ed3-40cc-9ff6-b8487af8070e tempest-VolumesSnapshotTestJSON-854675887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8036d784-1ed3-40cc-9ff6-b8487af8070e tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8036d784-1ed3-40cc-9ff6-b8487af8070e tempest-VolumesSnapshotTestJSON-854675887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:53:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8036d784-1ed3-40cc-9ff6-b8487af8070e tempest-VolumesSnapshotTestJSON-854675887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:53:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8036d784-1ed3-40cc-9ff6-b8487af8070e tempest-VolumesSnapshotTestJSON-854675887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8036d784-1ed3-40cc-9ff6-b8487af8070e tempest-VolumesSnapshotTestJSON-854675887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:18 devstack sudo[99301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:53:18 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-1b8cc85a-213c-4688-9224-520e61cb017a req-472b658e-7b1e-4355-aaa5-a08def38d0b9 tempest-AttachVolumeNegativeTest-470973352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-1b8cc85a-213c-4688-9224-520e61cb017a req-472b658e-7b1e-4355-aaa5-a08def38d0b9 tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-1b8cc85a-213c-4688-9224-520e61cb017a req-472b658e-7b1e-4355-aaa5-a08def38d0b9 tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:19 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-1b8cc85a-213c-4688-9224-520e61cb017a req-472b658e-7b1e-4355-aaa5-a08def38d0b9 tempest-AttachVolumeNegativeTest-470973352 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285', 'name': 'volume-6b4e4b76-4587-4f38-aa1c-b0f8e3548c36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f819da11-4e46-4508-9d83-4d49101ae61d', 'enforce_multipath': True} {{(pid=87571) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:53:19 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8036d784-1ed3-40cc-9ff6-b8487af8070e tempest-VolumesSnapshotTestJSON-854675887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.334s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:19 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-8036d784-1ed3-40cc-9ff6-b8487af8070e tempest-VolumesSnapshotTestJSON-854675887 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:53:19 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-8036d784-1ed3-40cc-9ff6-b8487af8070e tempest-VolumesSnapshotTestJSON-854675887 None] Deleted volume successfully. Sep 07 13:53:19 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-1b8cc85a-213c-4688-9224-520e61cb017a req-472b658e-7b1e-4355-aaa5-a08def38d0b9 tempest-AttachVolumeNegativeTest-470973352 None] attachment_update completed successfully. Sep 07 13:53:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8036d784-1ed3-40cc-9ff6-b8487af8070e tempest-VolumesSnapshotTestJSON-854675887 None] Lock "cinder-cee4f461-c874-42e3-b912-a88cf645427f-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Flow 'volume_create_manager' (127d91c7-99e2-442b-a7ae-e14e8d290802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae47796-87aa-46f8-b8d6-697b5ac3b01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae47796-87aa-46f8-b8d6-697b5ac3b01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-833323013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=545c3600-6250-4742-a489-392f349ff717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618b5e641b8449ad82e831f4473e0f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:53:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:53:20Z,use_quota=True,user_id='6745f0443fed467e8b55224582770814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3137b293-0cb2-4574-acad-a5105b9374ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3137b293-0cb2-4574-acad-a5105b9374ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987b95a9-9833-4704-9cd5-baf3a4187b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987b95a9-9833-4704-9cd5-baf3a4187b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '545c3600-6250-4742-a489-392f349ff717', 'volume_name': 'volume-545c3600-6250-4742-a489-392f349ff717', 'volume_size': 2}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a4df45-030a-4230-b248-a5082b84a795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a4df45-030a-4230-b248-a5082b84a795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3ed3e3-ad75-493a-aec3-6c30f21554ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:20 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Volume 545c3600-6250-4742-a489-392f349ff717: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-545c3600-6250-4742-a489-392f349ff717', 'volume_size': 2} Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-833323013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=545c3600-6250-4742-a489-392f349ff717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618b5e641b8449ad82e831f4473e0f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:53:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:53:20Z,use_quota=True,user_id='6745f0443fed467e8b55224582770814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Creating volume 545c3600-6250-4742-a489-392f349ff717 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:53:20 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717 2147483648 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:20 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717 2147483648 Sep 07 13:53:20 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:20 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717 2147483648" returned: 0 in 0.646s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:21 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717 Sep 07 13:53:21 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:21 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717" returned: 0 in 0.284s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:53:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3ed3e3-ad75-493a-aec3-6c30f21554ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-545c3600-6250-4742-a489-392f349ff717', 'volume_size': 2}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1296e1f-515e-4fde-ac95-a7f8c2252eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:21 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Volume volume-545c3600-6250-4742-a489-392f349ff717 (545c3600-6250-4742-a489-392f349ff717): created successfully Sep 07 13:53:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1296e1f-515e-4fde-ac95-a7f8c2252eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Flow 'volume_create_manager' (127d91c7-99e2-442b-a7ae-e14e8d290802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:53:21 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-22639408-73d5-44c9-906b-23b81d3833f6 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Created volume successfully. Sep 07 13:53:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-83e1e3a0-23f0-436a-8a46-610551a0f7b4 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-83e1e3a0-23f0-436a-8a46-610551a0f7b4 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-83e1e3a0-23f0-436a-8a46-610551a0f7b4 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Creating offline snapshot 0943c29d-6897-46d2-b0d0-031e387e82ce of volume 545c3600-6250-4742-a489-392f349ff717 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:53:22 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[99355476-0897-4e35-8572-f0a555a3eb1e]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-83e1e3a0-23f0-436a-8a46-610551a0f7b4 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:22 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717 Sep 07 13:53:22 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:22 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-83e1e3a0-23f0-436a-8a46-610551a0f7b4 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717" returned: 0 in 0.372s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-83e1e3a0-23f0-436a-8a46-610551a0f7b4 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.0943c29d-6897-46d2-b0d0-031e387e82ce 2G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:22 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.0943c29d-6897-46d2-b0d0-031e387e82ce 2G Sep 07 13:53:22 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:23 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-83e1e3a0-23f0-436a-8a46-610551a0f7b4 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.0943c29d-6897-46d2-b0d0-031e387e82ce 2G" returned: 0 in 0.653s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-83e1e3a0-23f0-436a-8a46-610551a0f7b4 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-545c3600-6250-4742-a489-392f349ff717 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.0943c29d-6897-46d2-b0d0-031e387e82ce {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:23 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-545c3600-6250-4742-a489-392f349ff717 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.0943c29d-6897-46d2-b0d0-031e387e82ce Sep 07 13:53:23 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:23 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-83e1e3a0-23f0-436a-8a46-610551a0f7b4 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-545c3600-6250-4742-a489-392f349ff717 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.0943c29d-6897-46d2-b0d0-031e387e82ce" returned: 0 in 0.304s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:23 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-83e1e3a0-23f0-436a-8a46-610551a0f7b4 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.0943c29d-6897-46d2-b0d0-031e387e82ce is being set with open permissions: ugo+rw Sep 07 13:53:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-83e1e3a0-23f0-436a-8a46-610551a0f7b4 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.0943c29d-6897-46d2-b0d0-031e387e82ce {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:23 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.0943c29d-6897-46d2-b0d0-031e387e82ce Sep 07 13:53:23 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:23 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-83e1e3a0-23f0-436a-8a46-610551a0f7b4 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.0943c29d-6897-46d2-b0d0-031e387e82ce" returned: 0 in 0.269s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-83e1e3a0-23f0-436a-8a46-610551a0f7b4 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:24 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.info Sep 07 13:53:24 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:24 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-83e1e3a0-23f0-436a-8a46-610551a0f7b4 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.info" returned: 0 in 0.307s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:24 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-83e1e3a0-23f0-436a-8a46-610551a0f7b4 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.info is being set with open permissions: ugo+rw Sep 07 13:53:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-83e1e3a0-23f0-436a-8a46-610551a0f7b4 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:24 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.info Sep 07 13:53:24 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:24 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-83e1e3a0-23f0-436a-8a46-610551a0f7b4 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.info" returned: 0 in 0.300s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-83e1e3a0-23f0-436a-8a46-610551a0f7b4 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.309s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:24 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-83e1e3a0-23f0-436a-8a46-610551a0f7b4 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Create snapshot completed successfully Sep 07 13:53:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2245c9d5-3c76-4867-8794-ef624e2c0564 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Acquiring lock "cinder-0943c29d-6897-46d2-b0d0-031e387e82ce-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2245c9d5-3c76-4867-8794-ef624e2c0564 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Lock "cinder-0943c29d-6897-46d2-b0d0-031e387e82ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2245c9d5-3c76-4867-8794-ef624e2c0564 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Acquiring lock "cinder-quobyte-545c3600-6250-4742-a489-392f349ff717" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2245c9d5-3c76-4867-8794-ef624e2c0564 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Lock "cinder-quobyte-545c3600-6250-4742-a489-392f349ff717" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2245c9d5-3c76-4867-8794-ef624e2c0564 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Acquiring lock "cinder-quobyte-0943c29d-6897-46d2-b0d0-031e387e82ce" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2245c9d5-3c76-4867-8794-ef624e2c0564 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Lock "cinder-quobyte-0943c29d-6897-46d2-b0d0-031e387e82ce" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-2245c9d5-3c76-4867-8794-ef624e2c0564 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Deleting offline snapshot 0943c29d-6897-46d2-b0d0-031e387e82ce of volume 545c3600-6250-4742-a489-392f349ff717 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:53:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-2245c9d5-3c76-4867-8794-ef624e2c0564 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] snapshot_file for this snap is: volume-545c3600-6250-4742-a489-392f349ff717.0943c29d-6897-46d2-b0d0-031e387e82ce {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:53:25 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[075c737f-09d1-4c49-a09b-c6f586519835]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2245c9d5-3c76-4867-8794-ef624e2c0564 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.0943c29d-6897-46d2-b0d0-031e387e82ce {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:25 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.0943c29d-6897-46d2-b0d0-031e387e82ce Sep 07 13:53:25 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:26 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2245c9d5-3c76-4867-8794-ef624e2c0564 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.0943c29d-6897-46d2-b0d0-031e387e82ce" returned: 0 in 0.498s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:26 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-2245c9d5-3c76-4867-8794-ef624e2c0564 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-545c3600-6250-4742-a489-392f349ff717(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:53:26 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[223c93cf-a1d8-4a58-90e8-be227b58dfe8]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2245c9d5-3c76-4867-8794-ef624e2c0564 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:26 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717 Sep 07 13:53:26 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:26 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2245c9d5-3c76-4867-8794-ef624e2c0564 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717" returned: 0 in 0.506s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2245c9d5-3c76-4867-8794-ef624e2c0564 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.0943c29d-6897-46d2-b0d0-031e387e82ce {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:26 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.0943c29d-6897-46d2-b0d0-031e387e82ce Sep 07 13:53:26 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:27 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2245c9d5-3c76-4867-8794-ef624e2c0564 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.0943c29d-6897-46d2-b0d0-031e387e82ce" returned: 0 in 0.520s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2245c9d5-3c76-4867-8794-ef624e2c0564 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.0943c29d-6897-46d2-b0d0-031e387e82ce {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:27 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.0943c29d-6897-46d2-b0d0-031e387e82ce Sep 07 13:53:27 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:27 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2245c9d5-3c76-4867-8794-ef624e2c0564 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717.0943c29d-6897-46d2-b0d0-031e387e82ce" returned: 0 in 0.380s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:27 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2245c9d5-3c76-4867-8794-ef624e2c0564 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Lock "cinder-quobyte-0943c29d-6897-46d2-b0d0-031e387e82ce" released by "_delete_snapshot" :: held 2.072s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:27 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2245c9d5-3c76-4867-8794-ef624e2c0564 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Lock "cinder-quobyte-545c3600-6250-4742-a489-392f349ff717" released by "delete_snapshot" :: held 2.110s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:27 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-2245c9d5-3c76-4867-8794-ef624e2c0564 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Created reservations ['e92575e0-b638-42dd-aa00-0048bb0021f6', '3bbd0441-b16f-4dcf-9db8-b55554045617', '49f4c931-44b0-4aae-8838-41824f36b8e5', 'e9166039-8c90-407a-9985-f3cf58088c0e'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:53:28 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-2245c9d5-3c76-4867-8794-ef624e2c0564 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Delete snapshot completed successfully. Sep 07 13:53:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2245c9d5-3c76-4867-8794-ef624e2c0564 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Lock "cinder-0943c29d-6897-46d2-b0d0-031e387e82ce-delete_snapshot" released by "delete_snapshot" :: held 2.417s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:53:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:53:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:53:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:28 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:53:28 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:28 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.314s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:53:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager._thread_info {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:53:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread count: 28 {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:53:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread info: [<_MainThread(MainThread, started 132147689414784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:53:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8bd47ef5-9c7d-480e-8c11-af01096dd2d2 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Acquiring lock "cinder-545c3600-6250-4742-a489-392f349ff717-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8bd47ef5-9c7d-480e-8c11-af01096dd2d2 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Lock "cinder-545c3600-6250-4742-a489-392f349ff717-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8bd47ef5-9c7d-480e-8c11-af01096dd2d2 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Acquiring lock "cinder-quobyte-545c3600-6250-4742-a489-392f349ff717" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8bd47ef5-9c7d-480e-8c11-af01096dd2d2 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Lock "cinder-quobyte-545c3600-6250-4742-a489-392f349ff717" acquired by "delete_volume" :: waited 0.025s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:29 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[433f4d5a-8501-4b3a-9a6e-a07ccc29e18c]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8bd47ef5-9c7d-480e-8c11-af01096dd2d2 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:29 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717 Sep 07 13:53:29 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:29 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8bd47ef5-9c7d-480e-8c11-af01096dd2d2 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717" returned: 0 in 0.441s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8bd47ef5-9c7d-480e-8c11-af01096dd2d2 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:29 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717 Sep 07 13:53:29 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:30 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8bd47ef5-9c7d-480e-8c11-af01096dd2d2 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-545c3600-6250-4742-a489-392f349ff717" returned: 0 in 0.319s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8bd47ef5-9c7d-480e-8c11-af01096dd2d2 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Lock "cinder-quobyte-545c3600-6250-4742-a489-392f349ff717" released by "delete_volume" :: held 0.884s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:30 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-8bd47ef5-9c7d-480e-8c11-af01096dd2d2 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Created reservations ['172bdd4d-2c59-4a06-a9bb-ea79835c0a34', 'd7a80c2c-3bd7-4c35-8a4e-da8c5fb71118', '1c366dc5-65bb-42e8-bd99-7b4c36e55a2e', 'dd8d6e0a-eb9c-465a-97e0-2466c56ec129'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:53:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8bd47ef5-9c7d-480e-8c11-af01096dd2d2 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8bd47ef5-9c7d-480e-8c11-af01096dd2d2 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8bd47ef5-9c7d-480e-8c11-af01096dd2d2 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:53:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8bd47ef5-9c7d-480e-8c11-af01096dd2d2 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:53:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8bd47ef5-9c7d-480e-8c11-af01096dd2d2 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8bd47ef5-9c7d-480e-8c11-af01096dd2d2 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:30 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:53:30 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:30 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8bd47ef5-9c7d-480e-8c11-af01096dd2d2 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.332s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:30 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-8bd47ef5-9c7d-480e-8c11-af01096dd2d2 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:53:30 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-8bd47ef5-9c7d-480e-8c11-af01096dd2d2 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Deleted volume successfully. Sep 07 13:53:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8bd47ef5-9c7d-480e-8c11-af01096dd2d2 tempest-VolumesSnapshotNegativeTestJSON-818273673 None] Lock "cinder-545c3600-6250-4742-a489-392f349ff717-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:40 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=38,cinder:INSERT=9,cinder:UPDATE=43,cinder:DELETE=3 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:53:40 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=38,cinder:INSERT=14,cinder:UPDATE=48,cinder:DELETE=4 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:54:07 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:54:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Flow 'volume_create_manager' (a5662033-2629-4d32-ad0e-fc686da8070e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:54:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5f51bd-9bef-4fbf-aa66-f396f2a2758e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5f51bd-9bef-4fbf-aa66-f396f2a2758e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2080463403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88ba148-d838-47dc-b0c8-8fe1ae072159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314ceaf0aef1498b8a49d5ad8fa4c566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:54:07Z,use_quota=True,user_id='380ec825ca1449e09fc50b4e398bb20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718c56df-a495-4bbb-9dc9-f4c67544cc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718c56df-a495-4bbb-9dc9-f4c67544cc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd795884-5b53-496f-86a9-369cfe10c3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd795884-5b53-496f-86a9-369cfe10c3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b88ba148-d838-47dc-b0c8-8fe1ae072159', 'volume_name': 'volume-b88ba148-d838-47dc-b0c8-8fe1ae072159', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7cee3cd-15d8-4289-919c-3accce71de6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7cee3cd-15d8-4289-919c-3accce71de6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c112db0-c568-4d21-9738-2bf9b01fbcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:07 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Volume b88ba148-d838-47dc-b0c8-8fe1ae072159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b88ba148-d838-47dc-b0c8-8fe1ae072159', 'volume_size': 1} Sep 07 13:54:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2080463403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88ba148-d838-47dc-b0c8-8fe1ae072159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314ceaf0aef1498b8a49d5ad8fa4c566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:54:07Z,use_quota=True,user_id='380ec825ca1449e09fc50b4e398bb20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:54:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Creating volume b88ba148-d838-47dc-b0c8-8fe1ae072159 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:54:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:54:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:54:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:54:07 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:54:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b88ba148-d838-47dc-b0c8-8fe1ae072159 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:07 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b88ba148-d838-47dc-b0c8-8fe1ae072159 1073741824 Sep 07 13:54:07 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Flow 'volume_create_manager' (88fff03e-be22-4d1f-9909-573566d6bf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded0522a-27a2-43fc-980f-d6e7af6a3123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded0522a-27a2-43fc-980f-d6e7af6a3123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1492415394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bebdee1-82c1-4250-bf67-845c45009817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314ceaf0aef1498b8a49d5ad8fa4c566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:54:08Z,use_quota=True,user_id='380ec825ca1449e09fc50b4e398bb20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc45c0d-6359-4ed3-9185-44eb5112aced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc45c0d-6359-4ed3-9185-44eb5112aced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ce51fd-9f3c-4b22-8859-4e28f5a8392f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ce51fd-9f3c-4b22-8859-4e28f5a8392f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bebdee1-82c1-4250-bf67-845c45009817', 'volume_name': 'volume-5bebdee1-82c1-4250-bf67-845c45009817', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fbd0384-3875-41f4-9918-e4019398b859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fbd0384-3875-41f4-9918-e4019398b859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68ccc87-52a9-415a-9eef-071dd9f8bbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:08 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Volume 5bebdee1-82c1-4250-bf67-845c45009817: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bebdee1-82c1-4250-bf67-845c45009817', 'volume_size': 1} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:08 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b88ba148-d838-47dc-b0c8-8fe1ae072159 1073741824" returned: 0 in 0.725s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b88ba148-d838-47dc-b0c8-8fe1ae072159 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:08 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b88ba148-d838-47dc-b0c8-8fe1ae072159 Sep 07 13:54:08 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:08 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b88ba148-d838-47dc-b0c8-8fe1ae072159" returned: 0 in 0.292s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.500s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1492415394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bebdee1-82c1-4250-bf67-845c45009817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314ceaf0aef1498b8a49d5ad8fa4c566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:54:08Z,use_quota=True,user_id='380ec825ca1449e09fc50b4e398bb20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Creating volume 5bebdee1-82c1-4250-bf67-845c45009817 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:54:08 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bebdee1-82c1-4250-bf67-845c45009817 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c112db0-c568-4d21-9738-2bf9b01fbcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b88ba148-d838-47dc-b0c8-8fe1ae072159', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:08 devstack sudo[99969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bebdee1-82c1-4250-bf67-845c45009817 1073741824 Sep 07 13:54:08 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b82ddf38-e409-4214-8232-69d3f6f38894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:08 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Volume volume-b88ba148-d838-47dc-b0c8-8fe1ae072159 (b88ba148-d838-47dc-b0c8-8fe1ae072159): created successfully Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b82ddf38-e409-4214-8232-69d3f6f38894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Flow 'volume_create_manager' (a5662033-2629-4d32-ad0e-fc686da8070e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:54:08 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-96296887-9f05-424c-a30f-317a2b1f175f tempest-TestServerVolumeAttachmentScenario-972667093 None] Created volume successfully. Sep 07 13:54:09 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bebdee1-82c1-4250-bf67-845c45009817 1073741824" returned: 0 in 0.533s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bebdee1-82c1-4250-bf67-845c45009817 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:09 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bebdee1-82c1-4250-bf67-845c45009817 Sep 07 13:54:09 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:09 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bebdee1-82c1-4250-bf67-845c45009817" returned: 0 in 0.277s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:09 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:54:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68ccc87-52a9-415a-9eef-071dd9f8bbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bebdee1-82c1-4250-bf67-845c45009817', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0218ef78-120a-44f3-8b49-2750c39eb0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:09 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Volume volume-5bebdee1-82c1-4250-bf67-845c45009817 (5bebdee1-82c1-4250-bf67-845c45009817): created successfully Sep 07 13:54:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0218ef78-120a-44f3-8b49-2750c39eb0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Flow 'volume_create_manager' (88fff03e-be22-4d1f-9909-573566d6bf8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:54:09 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-4add65b6-e1d4-48d3-a47c-e0abfe6aa508 tempest-TestServerVolumeAttachmentScenario-972667093 None] Created volume successfully. Sep 07 13:54:19 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:UPDATE=4,cinder:SELECT=4,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:54:19 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=4,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Flow 'volume_create_manager' (e74ca3c6-0018-4417-a004-e3f51e673428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d571d9-029f-40e5-b17b-f27252903d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d571d9-029f-40e5-b17b-f27252903d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-18093186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71785ae8-a00e-49b6-8570-ca900e8a2a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5bb667ef33a4e02996be30b3415d642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:54:20Z,use_quota=True,user_id='0743bd9d60ff4143adbf529907d59694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f4738a-a2ec-47ea-a3fc-b7501f35bac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f4738a-a2ec-47ea-a3fc-b7501f35bac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c5ad93-bfb5-4064-945c-d2f3dce72d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c5ad93-bfb5-4064-945c-d2f3dce72d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71785ae8-a00e-49b6-8570-ca900e8a2a23', 'volume_name': 'volume-71785ae8-a00e-49b6-8570-ca900e8a2a23', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e92621ba-5963-4685-9344-5088c5f02048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e92621ba-5963-4685-9344-5088c5f02048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (137ebacc-958f-42e9-9e15-d23fb251163f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:20 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Volume 71785ae8-a00e-49b6-8570-ca900e8a2a23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71785ae8-a00e-49b6-8570-ca900e8a2a23', 'volume_size': 1} Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-18093186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71785ae8-a00e-49b6-8570-ca900e8a2a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5bb667ef33a4e02996be30b3415d642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:54:20Z,use_quota=True,user_id='0743bd9d60ff4143adbf529907d59694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Creating volume 71785ae8-a00e-49b6-8570-ca900e8a2a23 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:54:20 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:20 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23 1073741824 Sep 07 13:54:20 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:20 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23 1073741824" returned: 0 in 0.564s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:20 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23 Sep 07 13:54:20 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:21 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23" returned: 0 in 0.409s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:54:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (137ebacc-958f-42e9-9e15-d23fb251163f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71785ae8-a00e-49b6-8570-ca900e8a2a23', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4a0ddd-b083-4d1b-80fa-816b7c5c5ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:21 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Volume volume-71785ae8-a00e-49b6-8570-ca900e8a2a23 (71785ae8-a00e-49b6-8570-ca900e8a2a23): created successfully Sep 07 13:54:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4a0ddd-b083-4d1b-80fa-816b7c5c5ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Flow 'volume_create_manager' (e74ca3c6-0018-4417-a004-e3f51e673428) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:54:21 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-15fd8edf-5c26-4d8d-acf9-f7060a24a9b1 tempest-TestImageHashVerification-1652169213 None] Created volume successfully. Sep 07 13:54:21 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-9b4921ee-99b3-46b8-adec-3e09353d4783 req-8f2abc3f-adf9-4f07-a6fb-5e75908b505c tempest-AttachVolumeNegativeTest-470973352 None] Terminate volume connection completed successfully. Sep 07 13:54:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-9b4921ee-99b3-46b8-adec-3e09353d4783 req-8f2abc3f-adf9-4f07-a6fb-5e75908b505c tempest-AttachVolumeNegativeTest-470973352 None] Deleting attachment f819da11-4e46-4508-9d83-4d49101ae61d. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:54:22 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:54:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Flow 'volume_create_manager' (a8cd1228-85d7-4498-bef5-eb050e8761f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:54:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981a25d5-1fe6-486e-a817-5098be7e7528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981a25d5-1fe6-486e-a817-5098be7e7528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-310871504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9edd4a1f-074b-4a33-894c-32ebe2aee79e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc7ea5e97c14530b572e072fa284967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:54:23Z,use_quota=True,user_id='9dd2e536604f416380a6bb0f0d6d9d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d8efe2e-7205-4382-9213-e62979cc165b),volume_type_id=9d8efe2e-7205-4382-9213-e62979cc165b)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1097f19b-f0c9-49ed-b0f6-ca1cbc0149bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1097f19b-f0c9-49ed-b0f6-ca1cbc0149bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161a71dd-a24e-494e-8992-986ad401b5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161a71dd-a24e-494e-8992-986ad401b5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9edd4a1f-074b-4a33-894c-32ebe2aee79e', 'volume_name': 'volume-9edd4a1f-074b-4a33-894c-32ebe2aee79e', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fcf8f58-31b0-49de-96a1-dd60ffc473f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fcf8f58-31b0-49de-96a1-dd60ffc473f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (927c26d2-81d6-4123-b593-dd0e14e2813d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:23 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Volume 9edd4a1f-074b-4a33-894c-32ebe2aee79e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9edd4a1f-074b-4a33-894c-32ebe2aee79e', 'volume_size': 1} Sep 07 13:54:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-310871504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9edd4a1f-074b-4a33-894c-32ebe2aee79e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc7ea5e97c14530b572e072fa284967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:54:23Z,use_quota=True,user_id='9dd2e536604f416380a6bb0f0d6d9d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d8efe2e-7205-4382-9213-e62979cc165b),volume_type_id=9d8efe2e-7205-4382-9213-e62979cc165b)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:54:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Creating volume 9edd4a1f-074b-4a33-894c-32ebe2aee79e {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:54:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:54:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:54:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:54:23 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:54:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9edd4a1f-074b-4a33-894c-32ebe2aee79e 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:23 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9edd4a1f-074b-4a33-894c-32ebe2aee79e 1073741824 Sep 07 13:54:23 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:23 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:54:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Flow 'volume_create_manager' (fed1fa3b-b113-4c71-ae35-b7cc109b8e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:54:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d588e52e-d00a-4b92-bc78-6a8def801f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d588e52e-d00a-4b92-bc78-6a8def801f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-233832428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe3b582-413f-479e-98d1-902afcf9e57a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc7ea5e97c14530b572e072fa284967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:54:24Z,use_quota=True,user_id='9dd2e536604f416380a6bb0f0d6d9d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b701de35-6c49-450b-9e15-50c875a48b85),volume_type_id=b701de35-6c49-450b-9e15-50c875a48b85)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a61509f-b361-48ce-8c4d-cc1948e8fb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a61509f-b361-48ce-8c4d-cc1948e8fb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8e8d93-590b-45ea-b31d-0e1b87d567c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8e8d93-590b-45ea-b31d-0e1b87d567c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abe3b582-413f-479e-98d1-902afcf9e57a', 'volume_name': 'volume-abe3b582-413f-479e-98d1-902afcf9e57a', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8466d3-830a-4e02-a284-97949fcf808b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8466d3-830a-4e02-a284-97949fcf808b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d8b184-fef8-4992-a656-a63c9627382b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:24 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Volume abe3b582-413f-479e-98d1-902afcf9e57a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abe3b582-413f-479e-98d1-902afcf9e57a', 'volume_size': 1} Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:24 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9edd4a1f-074b-4a33-894c-32ebe2aee79e 1073741824" returned: 0 in 1.020s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9edd4a1f-074b-4a33-894c-32ebe2aee79e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:24 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9edd4a1f-074b-4a33-894c-32ebe2aee79e Sep 07 13:54:24 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:24 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9edd4a1f-074b-4a33-894c-32ebe2aee79e" returned: 0 in 0.402s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.567s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-233832428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe3b582-413f-479e-98d1-902afcf9e57a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc7ea5e97c14530b572e072fa284967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:54:24Z,use_quota=True,user_id='9dd2e536604f416380a6bb0f0d6d9d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b701de35-6c49-450b-9e15-50c875a48b85),volume_type_id=b701de35-6c49-450b-9e15-50c875a48b85)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Creating volume abe3b582-413f-479e-98d1-902afcf9e57a {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:54:24 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abe3b582-413f-479e-98d1-902afcf9e57a 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6ac8ab43-38d1-47f5-a8ee-12fb2ace3d03 tempest-TestImageHashVerification-1652169213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:24 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abe3b582-413f-479e-98d1-902afcf9e57a 1073741824 Sep 07 13:54:24 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (927c26d2-81d6-4123-b593-dd0e14e2813d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9edd4a1f-074b-4a33-894c-32ebe2aee79e', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5da4c6-718d-4aa1-9e5b-f0a17b46a8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:24 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Volume volume-9edd4a1f-074b-4a33-894c-32ebe2aee79e (9edd4a1f-074b-4a33-894c-32ebe2aee79e): created successfully Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5da4c6-718d-4aa1-9e5b-f0a17b46a8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Flow 'volume_create_manager' (a8cd1228-85d7-4498-bef5-eb050e8761f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:54:24 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-280ce24c-8a17-4a73-a33f-cac902bff162 tempest-TestInstancesWithCinderVolumes-1271306196 None] Created volume successfully. Sep 07 13:54:25 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:54:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Flow 'volume_create_manager' (90d90fd8-721e-4fb0-8f08-9140c5bf70a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:54:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4bacdb-7a34-4d73-aca7-31267ada97cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4bacdb-7a34-4d73-aca7-31267ada97cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-936447661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7841aae-14eb-4c3e-9638-5c76856673ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc7ea5e97c14530b572e072fa284967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:54:25Z,use_quota=True,user_id='9dd2e536604f416380a6bb0f0d6d9d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e533b84-3673-43b5-ba51-b61ca3ab3dd2),volume_type_id=6e533b84-3673-43b5-ba51-b61ca3ab3dd2)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8226ac01-c5d4-48b2-b365-54bd597d9816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8226ac01-c5d4-48b2-b365-54bd597d9816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:25 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac26f4d6-80e3-4e5e-bf97-06902eb6a1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:25 devstack cinder-volume[87571]: DEBUG cinder.image.glance [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Creating Keystone auth plugin from conf {{(pid=87571) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 13:54:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abe3b582-413f-479e-98d1-902afcf9e57a 1073741824" returned: 0 in 0.788s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abe3b582-413f-479e-98d1-902afcf9e57a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:25 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abe3b582-413f-479e-98d1-902afcf9e57a Sep 07 13:54:25 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:25 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac26f4d6-80e3-4e5e-bf97-06902eb6a1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e7841aae-14eb-4c3e-9638-5c76856673ac', 'volume_name': 'volume-e7841aae-14eb-4c3e-9638-5c76856673ac', 'volume_size': 1, 'image_id': 'fbcef9de-1189-47a4-b9e6-a028ae6e693f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbcef9de-1189-47a4-b9e6-a028ae6e693f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--115139836', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bc7ea5e97c14530b572e072fa284967', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbcef9de-1189-47a4-b9e6-a028ae6e693f', 'created_at': datetime.datetime(2026, 9, 7, 11, 54, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 54, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbcef9de-1189-47a4-b9e6-a028ae6e693f/file', 'properties': {}}, 'image_service': }' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9154025-e6cf-4cb5-b327-bb6b17128c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9154025-e6cf-4cb5-b327-bb6b17128c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df914f44-793a-4e42-ace6-51b110c293fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:25 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Volume e7841aae-14eb-4c3e-9638-5c76856673ac: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e7841aae-14eb-4c3e-9638-5c76856673ac', 'volume_size': 1, 'image_id': 'fbcef9de-1189-47a4-b9e6-a028ae6e693f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbcef9de-1189-47a4-b9e6-a028ae6e693f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--115139836', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bc7ea5e97c14530b572e072fa284967', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbcef9de-1189-47a4-b9e6-a028ae6e693f', 'created_at': datetime.datetime(2026, 9, 7, 11, 54, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 54, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbcef9de-1189-47a4-b9e6-a028ae6e693f/file', 'properties': {}}, 'image_service': } Sep 07 13:54:25 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Trying to clone e7841aae-14eb-4c3e-9638-5c76856673ac from image fbcef9de-1189-47a4-b9e6-a028ae6e693f at location (None, [{'url': 'file:///opt/stack/data/glance/images/fbcef9de-1189-47a4-b9e6-a028ae6e693f', 'metadata': {}}]). {{(pid=87571) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1099}} Sep 07 13:54:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abe3b582-413f-479e-98d1-902afcf9e57a" returned: 0 in 0.428s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:54:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6ac8ab43-38d1-47f5-a8ee-12fb2ace3d03 tempest-TestImageHashVerification-1652169213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.196s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d8b184-fef8-4992-a656-a63c9627382b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abe3b582-413f-479e-98d1-902afcf9e57a', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c025b299-bdaa-41c6-894f-7425d1ead4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:26 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5af63ba-83e6-46e6-9062-a6534842c3f7]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:54:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6ac8ab43-38d1-47f5-a8ee-12fb2ace3d03 tempest-TestImageHashVerification-1652169213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:26 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Volume volume-abe3b582-413f-479e-98d1-902afcf9e57a (abe3b582-413f-479e-98d1-902afcf9e57a): created successfully Sep 07 13:54:26 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c025b299-bdaa-41c6-894f-7425d1ead4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:26 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Flow 'volume_create_manager' (fed1fa3b-b113-4c71-ae35-b7cc109b8e87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:54:26 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-d41dcf21-15ea-42ae-8f27-22318e6c21ab tempest-TestInstancesWithCinderVolumes-1271306196 None] Created volume successfully. Sep 07 13:54:26 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23 Sep 07 13:54:26 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:26 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6ac8ab43-38d1-47f5-a8ee-12fb2ace3d03 tempest-TestImageHashVerification-1652169213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23" returned: 0 in 0.510s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:26 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c813802-fbe7-45f6-8ec0-c4b84bdce2ac]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:54:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6ac8ab43-38d1-47f5-a8ee-12fb2ace3d03 tempest-TestImageHashVerification-1652169213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:26 devstack sudo[100083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23 Sep 07 13:54:26 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:26 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6ac8ab43-38d1-47f5-a8ee-12fb2ace3d03 tempest-TestImageHashVerification-1652169213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23" returned: 0 in 0.424s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6ac8ab43-38d1-47f5-a8ee-12fb2ace3d03 tempest-TestImageHashVerification-1652169213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23 /opt/stack/data/cinder/conversion/71785ae8-a00e-49b6-8570-ca900e8a2a23.temp_image.217c8c7d-0a94-467d-9117-23529a0205040j33p54a.img {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:26 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23 /opt/stack/data/cinder/conversion/71785ae8-a00e-49b6-8570-ca900e8a2a23.temp_image.217c8c7d-0a94-467d-9117-23529a0205040j33p54a.img Sep 07 13:54:26 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:54:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:54:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:54:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:28 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:54:28 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:29 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 1.120s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:29 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:54:29 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager._thread_info {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:54:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread count: 28 {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:54:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread info: [<_MainThread(MainThread, started 132147689414784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:54:34 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6ac8ab43-38d1-47f5-a8ee-12fb2ace3d03 tempest-TestImageHashVerification-1652169213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23 /opt/stack/data/cinder/conversion/71785ae8-a00e-49b6-8570-ca900e8a2a23.temp_image.217c8c7d-0a94-467d-9117-23529a0205040j33p54a.img" returned: 0 in 7.676s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:34 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[316b88ce-7113-4784-820f-79c51bf7ab6e]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:54:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6ac8ab43-38d1-47f5-a8ee-12fb2ace3d03 tempest-TestImageHashVerification-1652169213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:34 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23 Sep 07 13:54:34 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:35 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6ac8ab43-38d1-47f5-a8ee-12fb2ace3d03 tempest-TestImageHashVerification-1652169213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23" returned: 0 in 0.804s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:35 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-6ac8ab43-38d1-47f5-a8ee-12fb2ace3d03 tempest-TestImageHashVerification-1652169213 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23, size 1024.00 MB, duration 7.68 sec, destination /opt/stack/data/cinder/conversion/71785ae8-a00e-49b6-8570-ca900e8a2a23.temp_image.217c8c7d-0a94-467d-9117-23529a0205040j33p54a.img {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:54:35 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-6ac8ab43-38d1-47f5-a8ee-12fb2ace3d03 tempest-TestImageHashVerification-1652169213 None] Converted 1024.00 MB image at 133.35 MB/s Sep 07 13:54:35 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-6ac8ab43-38d1-47f5-a8ee-12fb2ace3d03 tempest-TestImageHashVerification-1652169213 None] 217c8c7d-0a94-467d-9117-23529a020504 was raw, no need to convert to raw {{(pid=87571) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 07 13:54:35 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fbcef9de-1189-47a4-b9e6-a028ae6e693f_kjrrnpqhdevstack@QuobyteHD, size 20.69 MB, duration 10.04 sec {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 13:54:35 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Image download 20.69 MB at 2.06 MB/s Sep 07 13:54:36 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edaea43-3280-457a-89e2-a946af3d0d08]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:54:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbcef9de-1189-47a4-b9e6-a028ae6e693f_kjrrnpqhdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:36 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbcef9de-1189-47a4-b9e6-a028ae6e693f_kjrrnpqhdevstack@QuobyteHD Sep 07 13:54:36 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:36 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbcef9de-1189-47a4-b9e6-a028ae6e693f_kjrrnpqhdevstack@QuobyteHD" returned: 0 in 0.683s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:36 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Temporary image fbcef9de-1189-47a4-b9e6-a028ae6e693f is fetched for user 9dd2e536604f416380a6bb0f0d6d9d02. {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 13:54:36 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3b6148-eb7d-4f38-b3a7-38b66c91f4ec]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:54:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbcef9de-1189-47a4-b9e6-a028ae6e693f_kjrrnpqhdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:37 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbcef9de-1189-47a4-b9e6-a028ae6e693f_kjrrnpqhdevstack@QuobyteHD Sep 07 13:54:37 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:37 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbcef9de-1189-47a4-b9e6-a028ae6e693f_kjrrnpqhdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:45 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=7,cinder:DELETE=3 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:54:46 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:UPDATE=12,cinder:SELECT=16,cinder:INSERT=1 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:54:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-ea8308c2-c879-41de-ae06-efc273a0fccb req-1d82aec7-66a0-4ecf-a700-414b2762b116 tempest-TestServerVolumeAttachmentScenario-972667093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6ac8ab43-38d1-47f5-a8ee-12fb2ace3d03 tempest-TestImageHashVerification-1652169213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.343s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-6ac8ab43-38d1-47f5-a8ee-12fb2ace3d03 tempest-TestImageHashVerification-1652169213 None] Uploaded volume to glance image-id: 217c8c7d-0a94-467d-9117-23529a020504. {{(pid=87571) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 13:55:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.957s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:00 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-936447661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7841aae-14eb-4c3e-9638-5c76856673ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc7ea5e97c14530b572e072fa284967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:54:25Z,use_quota=True,user_id='9dd2e536604f416380a6bb0f0d6d9d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e533b84-3673-43b5-ba51-b61ca3ab3dd2),volume_type_id=6e533b84-3673-43b5-ba51-b61ca3ab3dd2)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:55:00 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Creating volume e7841aae-14eb-4c3e-9638-5c76856673ac {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:55:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:00 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:00 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:00 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:55:00 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:55:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e7841aae-14eb-4c3e-9638-5c76856673ac 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:00 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e7841aae-14eb-4c3e-9638-5c76856673ac 1073741824 Sep 07 13:55:00 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:00 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-6ac8ab43-38d1-47f5-a8ee-12fb2ace3d03 tempest-TestImageHashVerification-1652169213 None] Copy volume to image completed successfully. Sep 07 13:55:00 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e7841aae-14eb-4c3e-9638-5c76856673ac 1073741824" returned: 0 in 0.436s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e7841aae-14eb-4c3e-9638-5c76856673ac {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:00 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e7841aae-14eb-4c3e-9638-5c76856673ac Sep 07 13:55:00 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:01 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e7841aae-14eb-4c3e-9638-5c76856673ac" returned: 0 in 0.255s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:55:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-ea8308c2-c879-41de-ae06-efc273a0fccb req-1d82aec7-66a0-4ecf-a700-414b2762b116 tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.291s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-ea8308c2-c879-41de-ae06-efc273a0fccb req-1d82aec7-66a0-4ecf-a700-414b2762b116 tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:01 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Attempting download of fbcef9de-1189-47a4-b9e6-a028ae6e693f ((None, [{'url': 'file:///opt/stack/data/glance/images/fbcef9de-1189-47a4-b9e6-a028ae6e693f', 'metadata': {}}])) to volume e7841aae-14eb-4c3e-9638-5c76856673ac. {{(pid=87571) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 13:55:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-ea8308c2-c879-41de-ae06-efc273a0fccb req-1d82aec7-66a0-4ecf-a700-414b2762b116 tempest-TestServerVolumeAttachmentScenario-972667093 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285', 'name': 'volume-b88ba148-d838-47dc-b0c8-8fe1ae072159', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32ebbcea-9b7f-41c2-8ef7-eac58b02e6ac', 'enforce_multipath': True} {{(pid=87571) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:55:01 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[895debfa-fec0-4a88-8653-9cdce76c39c7]: (4, 'raw') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbcef9de-1189-47a4-b9e6-a028ae6e693f_9fd3yzv4 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:01 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-ea8308c2-c879-41de-ae06-efc273a0fccb req-1d82aec7-66a0-4ecf-a700-414b2762b116 tempest-TestServerVolumeAttachmentScenario-972667093 None] attachment_update completed successfully. Sep 07 13:55:01 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbcef9de-1189-47a4-b9e6-a028ae6e693f_9fd3yzv4 Sep 07 13:55:01 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:01 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6fb20fec-14f4-48ee-a28d-8359d7503407 tempest-TestImageHashVerification-1652169213 None] Acquiring lock "cinder-71785ae8-a00e-49b6-8570-ca900e8a2a23-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:01 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbcef9de-1189-47a4-b9e6-a028ae6e693f_9fd3yzv4" returned: 0 in 0.422s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbcef9de-1189-47a4-b9e6-a028ae6e693f_9fd3yzv4 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:01 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6fb20fec-14f4-48ee-a28d-8359d7503407 tempest-TestImageHashVerification-1652169213 None] Lock "cinder-71785ae8-a00e-49b6-8570-ca900e8a2a23-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:01 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6fb20fec-14f4-48ee-a28d-8359d7503407 tempest-TestImageHashVerification-1652169213 None] Acquiring lock "cinder-quobyte-71785ae8-a00e-49b6-8570-ca900e8a2a23" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:01 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6fb20fec-14f4-48ee-a28d-8359d7503407 tempest-TestImageHashVerification-1652169213 None] Lock "cinder-quobyte-71785ae8-a00e-49b6-8570-ca900e8a2a23" acquired by "delete_volume" :: waited 0.030s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:01 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40eab5c-d0c9-4733-b759-1d0ad896f02d]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6fb20fec-14f4-48ee-a28d-8359d7503407 tempest-TestImageHashVerification-1652169213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:01 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbcef9de-1189-47a4-b9e6-a028ae6e693f_9fd3yzv4 Sep 07 13:55:01 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:01 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23 Sep 07 13:55:01 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:02 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbcef9de-1189-47a4-b9e6-a028ae6e693f_9fd3yzv4" returned: 1 in 0.490s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbcef9de-1189-47a4-b9e6-a028ae6e693f_9fd3yzv4' failed. Not Retrying. {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 13:55:02 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ece0a5-777e-4b9d-a213-e957542951e6]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbcef9de-1189-47a4-b9e6-a028ae6e693f_kjrrnpqhdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:02 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbcef9de-1189-47a4-b9e6-a028ae6e693f_kjrrnpqhdevstack@QuobyteHD Sep 07 13:55:02 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:02 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6fb20fec-14f4-48ee-a28d-8359d7503407 tempest-TestImageHashVerification-1652169213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23" returned: 0 in 0.556s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6fb20fec-14f4-48ee-a28d-8359d7503407 tempest-TestImageHashVerification-1652169213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:02 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23 Sep 07 13:55:02 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:02 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbcef9de-1189-47a4-b9e6-a028ae6e693f_kjrrnpqhdevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:02 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] fbcef9de-1189-47a4-b9e6-a028ae6e693f was qcow2, converting to qcow2 {{(pid=87571) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 13:55:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbcef9de-1189-47a4-b9e6-a028ae6e693f_kjrrnpqhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e7841aae-14eb-4c3e-9638-5c76856673ac {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:02 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbcef9de-1189-47a4-b9e6-a028ae6e693f_kjrrnpqhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e7841aae-14eb-4c3e-9638-5c76856673ac Sep 07 13:55:02 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:02 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6fb20fec-14f4-48ee-a28d-8359d7503407 tempest-TestImageHashVerification-1652169213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-71785ae8-a00e-49b6-8570-ca900e8a2a23" returned: 0 in 0.290s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6fb20fec-14f4-48ee-a28d-8359d7503407 tempest-TestImageHashVerification-1652169213 None] Lock "cinder-quobyte-71785ae8-a00e-49b6-8570-ca900e8a2a23" released by "delete_volume" :: held 0.893s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:55:02 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-6fb20fec-14f4-48ee-a28d-8359d7503407 tempest-TestImageHashVerification-1652169213 None] Created reservations ['53b7ce1c-55e9-4a63-9e12-a7b7d3a07cc0', '183a24fe-4063-4492-9b62-687d9772e87e', 'a715725a-f1a0-4a19-aad4-bd2cd215d203', '74d33a29-d9fe-4cbd-b888-1007f9b1052f'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:55:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6fb20fec-14f4-48ee-a28d-8359d7503407 tempest-TestImageHashVerification-1652169213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6fb20fec-14f4-48ee-a28d-8359d7503407 tempest-TestImageHashVerification-1652169213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-6fb20fec-14f4-48ee-a28d-8359d7503407 tempest-TestImageHashVerification-1652169213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-6fb20fec-14f4-48ee-a28d-8359d7503407 tempest-TestImageHashVerification-1652169213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6fb20fec-14f4-48ee-a28d-8359d7503407 tempest-TestImageHashVerification-1652169213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6fb20fec-14f4-48ee-a28d-8359d7503407 tempest-TestImageHashVerification-1652169213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:02 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:55:02 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:03 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6fb20fec-14f4-48ee-a28d-8359d7503407 tempest-TestImageHashVerification-1652169213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.313s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:03 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-6fb20fec-14f4-48ee-a28d-8359d7503407 tempest-TestImageHashVerification-1652169213 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:55:03 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-6fb20fec-14f4-48ee-a28d-8359d7503407 tempest-TestImageHashVerification-1652169213 None] Deleted volume successfully. Sep 07 13:55:03 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6fb20fec-14f4-48ee-a28d-8359d7503407 tempest-TestImageHashVerification-1652169213 None] Lock "cinder-71785ae8-a00e-49b6-8570-ca900e8a2a23-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:55:04 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbcef9de-1189-47a4-b9e6-a028ae6e693f_kjrrnpqhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e7841aae-14eb-4c3e-9638-5c76856673ac" returned: 0 in 2.158s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:04 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fbcef9de-1189-47a4-b9e6-a028ae6e693f_kjrrnpqhdevstack@QuobyteHD, size 112.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e7841aae-14eb-4c3e-9638-5c76856673ac {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:55:04 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Converted 112.00 MB image at 51.88 MB/s Sep 07 13:55:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e7841aae-14eb-4c3e-9638-5c76856673ac 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:04 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e7841aae-14eb-4c3e-9638-5c76856673ac 1G Sep 07 13:55:04 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:05 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e7841aae-14eb-4c3e-9638-5c76856673ac 1G" returned: 0 in 0.566s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:05 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Downloaded image fbcef9de-1189-47a4-b9e6-a028ae6e693f ((None, [{'url': 'file:///opt/stack/data/glance/images/fbcef9de-1189-47a4-b9e6-a028ae6e693f', 'metadata': {}}])) to volume e7841aae-14eb-4c3e-9638-5c76856673ac successfully. {{(pid=87571) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 13:55:05 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Temporary image fbcef9de-1189-47a4-b9e6-a028ae6e693f for user 9dd2e536604f416380a6bb0f0d6d9d02 is deleted. {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 13:55:05 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Marking volume e7841aae-14eb-4c3e-9638-5c76856673ac as bootable. {{(pid=87571) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 13:55:05 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Copying metadata from image fbcef9de-1189-47a4-b9e6-a028ae6e693f to e7841aae-14eb-4c3e-9638-5c76856673ac. {{(pid=87571) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 13:55:05 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Creating volume glance metadata for volume e7841aae-14eb-4c3e-9638-5c76856673ac backed by image fbcef9de-1189-47a4-b9e6-a028ae6e693f with: {'image_id': 'fbcef9de-1189-47a4-b9e6-a028ae6e693f', 'image_name': 'tempest-scenario-img--115139836', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87571) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 13:55:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df914f44-793a-4e42-ace6-51b110c293fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7841aae-14eb-4c3e-9638-5c76856673ac', 'volume_size': 1, 'image_id': 'fbcef9de-1189-47a4-b9e6-a028ae6e693f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbcef9de-1189-47a4-b9e6-a028ae6e693f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--115139836', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bc7ea5e97c14530b572e072fa284967', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbcef9de-1189-47a4-b9e6-a028ae6e693f', 'created_at': datetime.datetime(2026, 9, 7, 11, 54, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 54, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbcef9de-1189-47a4-b9e6-a028ae6e693f/file', 'properties': {}}, 'image_service': }' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c194ed1-d734-40de-9725-5e5bd9dca9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:05 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Volume volume-e7841aae-14eb-4c3e-9638-5c76856673ac (e7841aae-14eb-4c3e-9638-5c76856673ac): created successfully Sep 07 13:55:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c194ed1-d734-40de-9725-5e5bd9dca9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Flow 'volume_create_manager' (90d90fd8-721e-4fb0-8f08-9140c5bf70a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:55:05 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-d467e639-a80a-4d33-a70f-877c6e349296 tempest-TestInstancesWithCinderVolumes-1271306196 None] Created volume successfully. Sep 07 13:55:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-a3ce1326-3823-499f-88df-595cd4c9af37 req-2b36260c-f994-4b4a-a6fe-7208b8dd7411 tempest-TestServerVolumeAttachmentScenario-972667093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-a3ce1326-3823-499f-88df-595cd4c9af37 req-2b36260c-f994-4b4a-a6fe-7208b8dd7411 tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-a3ce1326-3823-499f-88df-595cd4c9af37 req-2b36260c-f994-4b4a-a6fe-7208b8dd7411 tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-a3ce1326-3823-499f-88df-595cd4c9af37 req-2b36260c-f994-4b4a-a6fe-7208b8dd7411 tempest-TestServerVolumeAttachmentScenario-972667093 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285', 'name': 'volume-5bebdee1-82c1-4250-bf67-845c45009817', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9c315e9-c516-486c-883a-ea76f0bc63ee', 'enforce_multipath': True} {{(pid=87571) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:55:06 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-a3ce1326-3823-499f-88df-595cd4c9af37 req-2b36260c-f994-4b4a-a6fe-7208b8dd7411 tempest-TestServerVolumeAttachmentScenario-972667093 None] attachment_update completed successfully. Sep 07 13:55:08 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-3340d897-d94e-401d-9276-923c9d585bbf req-f4d2b8d5-005d-44cd-8e12-bd6707faf6a4 tempest-TestServerVolumeAttachmentScenario-972667093 None] Terminate volume connection completed successfully. Sep 07 13:55:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-3340d897-d94e-401d-9276-923c9d585bbf req-f4d2b8d5-005d-44cd-8e12-bd6707faf6a4 tempest-TestServerVolumeAttachmentScenario-972667093 None] Deleting attachment b9c315e9-c516-486c-883a-ea76f0bc63ee. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:55:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-b06c8fca-16a5-4e10-b979-68b4a7aa0c92 req-e868209d-8907-46f5-9cf7-546303d1eabf tempest-TestInstancesWithCinderVolumes-1271306196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-b06c8fca-16a5-4e10-b979-68b4a7aa0c92 req-e868209d-8907-46f5-9cf7-546303d1eabf tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-b06c8fca-16a5-4e10-b979-68b4a7aa0c92 req-e868209d-8907-46f5-9cf7-546303d1eabf tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-b06c8fca-16a5-4e10-b979-68b4a7aa0c92 req-e868209d-8907-46f5-9cf7-546303d1eabf tempest-TestInstancesWithCinderVolumes-1271306196 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285', 'name': 'volume-e7841aae-14eb-4c3e-9638-5c76856673ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6445d40a-1173-4334-b289-c93ad0d015d0', 'enforce_multipath': True} {{(pid=87571) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:55:09 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-b06c8fca-16a5-4e10-b979-68b4a7aa0c92 req-e868209d-8907-46f5-9cf7-546303d1eabf tempest-TestInstancesWithCinderVolumes-1271306196 None] attachment_update completed successfully. Sep 07 13:55:09 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:55:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Flow 'volume_create_manager' (5288d88f-35e7-4333-baeb-947d496b094f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:55:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bc9ec43-0c69-4ec8-8f9d-1fe9b51ab8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bc9ec43-0c69-4ec8-8f9d-1fe9b51ab8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1526751534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb55ae3-f644-42fe-b8e2-96d1443d7085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6147a7e49abf47eda252408fb0741f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:10Z,use_quota=True,user_id='34aacec7b8284f38a711d350e4e44e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (285b26df-bc2c-41e0-b85c-c0031250ef37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (285b26df-bc2c-41e0-b85c-c0031250ef37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2da14f5-b373-4700-bb2c-226cdd300269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2da14f5-b373-4700-bb2c-226cdd300269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deb55ae3-f644-42fe-b8e2-96d1443d7085', 'volume_name': 'volume-deb55ae3-f644-42fe-b8e2-96d1443d7085', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b63aeff-275d-49c5-9331-a2a12f5586c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b63aeff-275d-49c5-9331-a2a12f5586c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66041cf2-7e66-4e43-a360-5f025a4ded18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:10 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Volume deb55ae3-f644-42fe-b8e2-96d1443d7085: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deb55ae3-f644-42fe-b8e2-96d1443d7085', 'volume_size': 1} Sep 07 13:55:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1526751534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb55ae3-f644-42fe-b8e2-96d1443d7085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6147a7e49abf47eda252408fb0741f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:10Z,use_quota=True,user_id='34aacec7b8284f38a711d350e4e44e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:55:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Creating volume deb55ae3-f644-42fe-b8e2-96d1443d7085 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:55:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:55:10 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:55:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-deb55ae3-f644-42fe-b8e2-96d1443d7085 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:10 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-deb55ae3-f644-42fe-b8e2-96d1443d7085 1073741824 Sep 07 13:55:10 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:10 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-1a54eda6-527d-4e45-8c9a-501aedb9fd2a req-77546261-8666-44b2-940f-43ebe0e27cbc tempest-TestServerVolumeAttachmentScenario-972667093 None] Terminate volume connection completed successfully. Sep 07 13:55:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-1a54eda6-527d-4e45-8c9a-501aedb9fd2a req-77546261-8666-44b2-940f-43ebe0e27cbc tempest-TestServerVolumeAttachmentScenario-972667093 None] Deleting attachment 32ebbcea-9b7f-41c2-8ef7-eac58b02e6ac. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:55:10 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-deb55ae3-f644-42fe-b8e2-96d1443d7085 1073741824" returned: 0 in 0.680s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-deb55ae3-f644-42fe-b8e2-96d1443d7085 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:10 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-deb55ae3-f644-42fe-b8e2-96d1443d7085 Sep 07 13:55:10 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:11 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-deb55ae3-f644-42fe-b8e2-96d1443d7085" returned: 0 in 0.355s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:11 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:55:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66041cf2-7e66-4e43-a360-5f025a4ded18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deb55ae3-f644-42fe-b8e2-96d1443d7085', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96894a8b-cca5-443e-a2a2-c29854a444a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:11 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Volume volume-deb55ae3-f644-42fe-b8e2-96d1443d7085 (deb55ae3-f644-42fe-b8e2-96d1443d7085): created successfully Sep 07 13:55:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96894a8b-cca5-443e-a2a2-c29854a444a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Flow 'volume_create_manager' (5288d88f-35e7-4333-baeb-947d496b094f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:55:11 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-ca77bb51-455d-4611-8342-ff6db63bc03b tempest-AttachVolumeNegativeTest-470973352 None] Created volume successfully. Sep 07 13:55:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-bb1f7ad3-2ba4-48a1-bfa2-dbc61f004c39 req-0d166f9c-d352-409a-8413-04129777591a tempest-AttachVolumeNegativeTest-470973352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-bb1f7ad3-2ba4-48a1-bfa2-dbc61f004c39 req-0d166f9c-d352-409a-8413-04129777591a tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-bb1f7ad3-2ba4-48a1-bfa2-dbc61f004c39 req-0d166f9c-d352-409a-8413-04129777591a tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-bb1f7ad3-2ba4-48a1-bfa2-dbc61f004c39 req-0d166f9c-d352-409a-8413-04129777591a tempest-AttachVolumeNegativeTest-470973352 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285', 'name': 'volume-deb55ae3-f644-42fe-b8e2-96d1443d7085', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08f8936a-c815-46bc-ac9d-2d79e35c9535', 'enforce_multipath': True} {{(pid=87571) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:55:13 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-bb1f7ad3-2ba4-48a1-bfa2-dbc61f004c39 req-0d166f9c-d352-409a-8413-04129777591a tempest-AttachVolumeNegativeTest-470973352 None] attachment_update completed successfully. Sep 07 13:55:16 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-9562047b-94b7-4f6f-afd9-5f835b04d2e2 req-8a52bfac-12a8-4f78-a71b-de4d26fdd4a2 tempest-AttachVolumeNegativeTest-470973352 None] Terminate volume connection completed successfully. Sep 07 13:55:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-9562047b-94b7-4f6f-afd9-5f835b04d2e2 req-8a52bfac-12a8-4f78-a71b-de4d26fdd4a2 tempest-AttachVolumeNegativeTest-470973352 None] Deleting attachment 08f8936a-c815-46bc-ac9d-2d79e35c9535. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:55:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-748176f0-5c09-4de2-913c-bf79693e4f27 tempest-TestServerVolumeAttachmentScenario-972667093 None] Acquiring lock "cinder-5bebdee1-82c1-4250-bf67-845c45009817-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-748176f0-5c09-4de2-913c-bf79693e4f27 tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "cinder-5bebdee1-82c1-4250-bf67-845c45009817-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-748176f0-5c09-4de2-913c-bf79693e4f27 tempest-TestServerVolumeAttachmentScenario-972667093 None] Acquiring lock "cinder-quobyte-5bebdee1-82c1-4250-bf67-845c45009817" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-748176f0-5c09-4de2-913c-bf79693e4f27 tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "cinder-quobyte-5bebdee1-82c1-4250-bf67-845c45009817" acquired by "delete_volume" :: waited 0.034s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:19 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf880d7-19ca-4232-84b8-234789e3c7b7]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-748176f0-5c09-4de2-913c-bf79693e4f27 tempest-TestServerVolumeAttachmentScenario-972667093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bebdee1-82c1-4250-bf67-845c45009817 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:19 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bebdee1-82c1-4250-bf67-845c45009817 Sep 07 13:55:19 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:19 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-748176f0-5c09-4de2-913c-bf79693e4f27 tempest-TestServerVolumeAttachmentScenario-972667093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bebdee1-82c1-4250-bf67-845c45009817" returned: 0 in 0.647s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-748176f0-5c09-4de2-913c-bf79693e4f27 tempest-TestServerVolumeAttachmentScenario-972667093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bebdee1-82c1-4250-bf67-845c45009817 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:19 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bebdee1-82c1-4250-bf67-845c45009817 Sep 07 13:55:19 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:20 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-748176f0-5c09-4de2-913c-bf79693e4f27 tempest-TestServerVolumeAttachmentScenario-972667093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-5bebdee1-82c1-4250-bf67-845c45009817" returned: 0 in 0.336s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-748176f0-5c09-4de2-913c-bf79693e4f27 tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "cinder-quobyte-5bebdee1-82c1-4250-bf67-845c45009817" released by "delete_volume" :: held 1.071s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:55:20 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-748176f0-5c09-4de2-913c-bf79693e4f27 tempest-TestServerVolumeAttachmentScenario-972667093 None] Created reservations ['057258f8-a99d-4b08-9c01-9f79a8dee480', '9bf49f94-f108-4715-93c0-05b597ee47be', 'e6b4913c-4a50-48c6-b255-1f4d97d355af', 'f96cbacf-dcd6-46ac-952f-d8428956d0f7'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:55:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-748176f0-5c09-4de2-913c-bf79693e4f27 tempest-TestServerVolumeAttachmentScenario-972667093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-748176f0-5c09-4de2-913c-bf79693e4f27 tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-748176f0-5c09-4de2-913c-bf79693e4f27 tempest-TestServerVolumeAttachmentScenario-972667093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-748176f0-5c09-4de2-913c-bf79693e4f27 tempest-TestServerVolumeAttachmentScenario-972667093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-748176f0-5c09-4de2-913c-bf79693e4f27 tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-748176f0-5c09-4de2-913c-bf79693e4f27 tempest-TestServerVolumeAttachmentScenario-972667093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:20 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:55:20 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:20 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-748176f0-5c09-4de2-913c-bf79693e4f27 tempest-TestServerVolumeAttachmentScenario-972667093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.455s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:20 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-748176f0-5c09-4de2-913c-bf79693e4f27 tempest-TestServerVolumeAttachmentScenario-972667093 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:55:20 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-748176f0-5c09-4de2-913c-bf79693e4f27 tempest-TestServerVolumeAttachmentScenario-972667093 None] Deleted volume successfully. Sep 07 13:55:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-748176f0-5c09-4de2-913c-bf79693e4f27 tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "cinder-5bebdee1-82c1-4250-bf67-845c45009817-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:55:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3785921c-e462-47fc-b75a-48e4c998f475 tempest-TestServerVolumeAttachmentScenario-972667093 None] Acquiring lock "cinder-b88ba148-d838-47dc-b0c8-8fe1ae072159-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3785921c-e462-47fc-b75a-48e4c998f475 tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "cinder-b88ba148-d838-47dc-b0c8-8fe1ae072159-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3785921c-e462-47fc-b75a-48e4c998f475 tempest-TestServerVolumeAttachmentScenario-972667093 None] Acquiring lock "cinder-quobyte-b88ba148-d838-47dc-b0c8-8fe1ae072159" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3785921c-e462-47fc-b75a-48e4c998f475 tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "cinder-quobyte-b88ba148-d838-47dc-b0c8-8fe1ae072159" acquired by "delete_volume" :: waited 0.039s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:21 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dc61e3-8946-43dc-9d4b-7555c59c3915]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3785921c-e462-47fc-b75a-48e4c998f475 tempest-TestServerVolumeAttachmentScenario-972667093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b88ba148-d838-47dc-b0c8-8fe1ae072159 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:22 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b88ba148-d838-47dc-b0c8-8fe1ae072159 Sep 07 13:55:22 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:22 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3785921c-e462-47fc-b75a-48e4c998f475 tempest-TestServerVolumeAttachmentScenario-972667093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b88ba148-d838-47dc-b0c8-8fe1ae072159" returned: 0 in 0.724s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3785921c-e462-47fc-b75a-48e4c998f475 tempest-TestServerVolumeAttachmentScenario-972667093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b88ba148-d838-47dc-b0c8-8fe1ae072159 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:22 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b88ba148-d838-47dc-b0c8-8fe1ae072159 Sep 07 13:55:22 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:22 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3785921c-e462-47fc-b75a-48e4c998f475 tempest-TestServerVolumeAttachmentScenario-972667093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b88ba148-d838-47dc-b0c8-8fe1ae072159" returned: 0 in 0.445s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:22 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3785921c-e462-47fc-b75a-48e4c998f475 tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "cinder-quobyte-b88ba148-d838-47dc-b0c8-8fe1ae072159" released by "delete_volume" :: held 1.271s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:55:23 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-3785921c-e462-47fc-b75a-48e4c998f475 tempest-TestServerVolumeAttachmentScenario-972667093 None] Created reservations ['7863798a-7678-45ad-9b00-f252d8b0d6c4', '22ac736b-12ce-483b-bfd1-441e2afd66b7', 'fb226091-e9bf-4781-8f40-7438a7278159', 'b6d6aee8-9d0e-460b-a3e7-228eacf6ea12'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:55:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3785921c-e462-47fc-b75a-48e4c998f475 tempest-TestServerVolumeAttachmentScenario-972667093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3785921c-e462-47fc-b75a-48e4c998f475 tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3785921c-e462-47fc-b75a-48e4c998f475 tempest-TestServerVolumeAttachmentScenario-972667093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3785921c-e462-47fc-b75a-48e4c998f475 tempest-TestServerVolumeAttachmentScenario-972667093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3785921c-e462-47fc-b75a-48e4c998f475 tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3785921c-e462-47fc-b75a-48e4c998f475 tempest-TestServerVolumeAttachmentScenario-972667093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:23 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:55:23 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:23 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3785921c-e462-47fc-b75a-48e4c998f475 tempest-TestServerVolumeAttachmentScenario-972667093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.335s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:23 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-3785921c-e462-47fc-b75a-48e4c998f475 tempest-TestServerVolumeAttachmentScenario-972667093 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:55:23 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-3785921c-e462-47fc-b75a-48e4c998f475 tempest-TestServerVolumeAttachmentScenario-972667093 None] Deleted volume successfully. Sep 07 13:55:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3785921c-e462-47fc-b75a-48e4c998f475 tempest-TestServerVolumeAttachmentScenario-972667093 None] Lock "cinder-b88ba148-d838-47dc-b0c8-8fe1ae072159-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:55:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:55:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:28 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:55:28 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:28 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.441s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:55:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager._thread_info {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:55:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread count: 28 {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:55:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread info: [<_MainThread(MainThread, started 132147689414784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:55:33 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=52,cinder:UPDATE=43,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:55:33 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:UPDATE=33,cinder:SELECT=53,cinder:INSERT=13,cinder:DELETE=3 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:55:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-58b792e4-6daa-4fc1-ab8a-feeb2204f553 req-c45f8623-6b9e-450d-92eb-4f7ccdfb8c07 tempest-TestInstancesWithCinderVolumes-1271306196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-58b792e4-6daa-4fc1-ab8a-feeb2204f553 req-c45f8623-6b9e-450d-92eb-4f7ccdfb8c07 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-58b792e4-6daa-4fc1-ab8a-feeb2204f553 req-c45f8623-6b9e-450d-92eb-4f7ccdfb8c07 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.076s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:50 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:55:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Flow 'volume_create_manager' (29e6c55d-ab3d-4394-8389-4050bec82fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:55:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb1aed2a-30eb-46a8-b349-a70651e84841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb1aed2a-30eb-46a8-b349-a70651e84841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-829291163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600de248-ece5-4441-baa4-bc46c5d14374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540d948240e146c8b5f708872330baad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:51Z,use_quota=True,user_id='0907543ffe9d406f80271558e5276e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f4a33d-3071-48cb-ac03-ee3754aa2560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f4a33d-3071-48cb-ac03-ee3754aa2560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb6a24d-5d6e-49ce-9b14-ddab89a2cf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb6a24d-5d6e-49ce-9b14-ddab89a2cf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '600de248-ece5-4441-baa4-bc46c5d14374', 'volume_name': 'volume-600de248-ece5-4441-baa4-bc46c5d14374', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed93338-1d0a-42c2-b447-70021ad5dfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed93338-1d0a-42c2-b447-70021ad5dfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74e27e3f-f66a-4b5d-b3b3-da62e82333ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:51 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Volume 600de248-ece5-4441-baa4-bc46c5d14374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-600de248-ece5-4441-baa4-bc46c5d14374', 'volume_size': 1} Sep 07 13:55:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-829291163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600de248-ece5-4441-baa4-bc46c5d14374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540d948240e146c8b5f708872330baad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:51Z,use_quota=True,user_id='0907543ffe9d406f80271558e5276e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:55:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Creating volume 600de248-ece5-4441-baa4-bc46c5d14374 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:55:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:55:51 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:55:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-600de248-ece5-4441-baa4-bc46c5d14374 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-58b792e4-6daa-4fc1-ab8a-feeb2204f553 req-c45f8623-6b9e-450d-92eb-4f7ccdfb8c07 tempest-TestInstancesWithCinderVolumes-1271306196 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285', 'name': 'volume-9edd4a1f-074b-4a33-894c-32ebe2aee79e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a1b04704-c68b-4626-9aa6-c972cb325120', 'enforce_multipath': True} {{(pid=87571) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:55:51 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-600de248-ece5-4441-baa4-bc46c5d14374 1073741824 Sep 07 13:55:51 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:51 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-58b792e4-6daa-4fc1-ab8a-feeb2204f553 req-c45f8623-6b9e-450d-92eb-4f7ccdfb8c07 tempest-TestInstancesWithCinderVolumes-1271306196 None] attachment_update completed successfully. Sep 07 13:55:52 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-600de248-ece5-4441-baa4-bc46c5d14374 1073741824" returned: 0 in 1.186s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-600de248-ece5-4441-baa4-bc46c5d14374 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:52 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-600de248-ece5-4441-baa4-bc46c5d14374 Sep 07 13:55:52 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:52 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-600de248-ece5-4441-baa4-bc46c5d14374" returned: 0 in 0.530s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:52 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:55:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:52 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74e27e3f-f66a-4b5d-b3b3-da62e82333ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-600de248-ece5-4441-baa4-bc46c5d14374', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:52 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535f991e-38ca-4ea9-bc46-a02b4a50af31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:52 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Volume volume-600de248-ece5-4441-baa4-bc46c5d14374 (600de248-ece5-4441-baa4-bc46c5d14374): created successfully Sep 07 13:55:52 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535f991e-38ca-4ea9-bc46-a02b4a50af31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:52 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Flow 'volume_create_manager' (29e6c55d-ab3d-4394-8389-4050bec82fa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:55:53 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-fc964c5c-e149-4404-87c8-7647b2f77f3c tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Created volume successfully. Sep 07 13:55:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-ee0b3b97-710c-4de5-b3c2-736af32d4736 req-45f9b1a2-295a-4d67-b54b-233b4b1c49e5 tempest-TestInstancesWithCinderVolumes-1271306196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-ee0b3b97-710c-4de5-b3c2-736af32d4736 req-45f9b1a2-295a-4d67-b54b-233b4b1c49e5 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-ee0b3b97-710c-4de5-b3c2-736af32d4736 req-45f9b1a2-295a-4d67-b54b-233b4b1c49e5 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-ee0b3b97-710c-4de5-b3c2-736af32d4736 req-45f9b1a2-295a-4d67-b54b-233b4b1c49e5 tempest-TestInstancesWithCinderVolumes-1271306196 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285', 'name': 'volume-abe3b582-413f-479e-98d1-902afcf9e57a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b53157fa-5ca0-409b-aa3f-ab755a97ec74', 'enforce_multipath': True} {{(pid=87571) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:55:54 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-ee0b3b97-710c-4de5-b3c2-736af32d4736 req-45f9b1a2-295a-4d67-b54b-233b4b1c49e5 tempest-TestInstancesWithCinderVolumes-1271306196 None] attachment_update completed successfully. Sep 07 13:55:55 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:55:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Flow 'volume_create_manager' (9b4e8282-0029-4439-a093-f474cb50c723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:55:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0038337f-5cde-4b8a-bf57-22c627b90f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0038337f-5cde-4b8a-bf57-22c627b90f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1050270169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb11b418-a5ba-4179-8538-b6bff19b6ef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540d948240e146c8b5f708872330baad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:55Z,use_quota=True,user_id='0907543ffe9d406f80271558e5276e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7875ba-2a47-4207-8e05-ccffd9457db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7875ba-2a47-4207-8e05-ccffd9457db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141665c6-4b1b-48af-926f-ddaf2fe46504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141665c6-4b1b-48af-926f-ddaf2fe46504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb11b418-a5ba-4179-8538-b6bff19b6ef0', 'volume_name': 'volume-bb11b418-a5ba-4179-8538-b6bff19b6ef0', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfbfd9e8-96a9-47e1-b8a1-3cc850ca78c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfbfd9e8-96a9-47e1-b8a1-3cc850ca78c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988854ec-83c0-46a9-9b95-3bb03da5c717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:55 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Volume bb11b418-a5ba-4179-8538-b6bff19b6ef0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb11b418-a5ba-4179-8538-b6bff19b6ef0', 'volume_size': 1} Sep 07 13:55:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1050270169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb11b418-a5ba-4179-8538-b6bff19b6ef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540d948240e146c8b5f708872330baad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:55Z,use_quota=True,user_id='0907543ffe9d406f80271558e5276e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:55:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Creating volume bb11b418-a5ba-4179-8538-b6bff19b6ef0 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:55:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:55:55 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:55:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bb11b418-a5ba-4179-8538-b6bff19b6ef0 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:55 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bb11b418-a5ba-4179-8538-b6bff19b6ef0 1073741824 Sep 07 13:55:55 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Flow 'volume_create_manager' (a26aa60e-a344-41d3-baf3-2d766595bb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9518dac1-6861-4da2-9c4e-63c4100a9ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9518dac1-6861-4da2-9c4e-63c4100a9ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1311210006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01e010e-3e30-46cf-81ea-1a711563aca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540d948240e146c8b5f708872330baad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:56Z,use_quota=True,user_id='0907543ffe9d406f80271558e5276e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6e1fe6-2771-427b-8970-862d2dac773d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6e1fe6-2771-427b-8970-862d2dac773d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae96811-ec02-445f-abf7-453ef64d08de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae96811-ec02-445f-abf7-453ef64d08de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b01e010e-3e30-46cf-81ea-1a711563aca7', 'volume_name': 'volume-b01e010e-3e30-46cf-81ea-1a711563aca7', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a483902-401b-4788-b636-5747080c994b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a483902-401b-4788-b636-5747080c994b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f7804e-8717-4660-9a83-ac0124b7a242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:56 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Volume b01e010e-3e30-46cf-81ea-1a711563aca7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b01e010e-3e30-46cf-81ea-1a711563aca7', 'volume_size': 1} Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:56 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bb11b418-a5ba-4179-8538-b6bff19b6ef0 1073741824" returned: 0 in 0.897s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bb11b418-a5ba-4179-8538-b6bff19b6ef0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:56 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bb11b418-a5ba-4179-8538-b6bff19b6ef0 Sep 07 13:55:56 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:56 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bb11b418-a5ba-4179-8538-b6bff19b6ef0" returned: 0 in 0.445s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.512s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1311210006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01e010e-3e30-46cf-81ea-1a711563aca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540d948240e146c8b5f708872330baad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:56Z,use_quota=True,user_id='0907543ffe9d406f80271558e5276e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Creating volume b01e010e-3e30-46cf-81ea-1a711563aca7 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:55:56 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:55:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b01e010e-3e30-46cf-81ea-1a711563aca7 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988854ec-83c0-46a9-9b95-3bb03da5c717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb11b418-a5ba-4179-8538-b6bff19b6ef0', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c4cd34-a6b6-47ed-91f7-395a43f5e8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:57 devstack sudo[102071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b01e010e-3e30-46cf-81ea-1a711563aca7 1073741824 Sep 07 13:55:57 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:57 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Volume volume-bb11b418-a5ba-4179-8538-b6bff19b6ef0 (bb11b418-a5ba-4179-8538-b6bff19b6ef0): created successfully Sep 07 13:55:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c4cd34-a6b6-47ed-91f7-395a43f5e8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Flow 'volume_create_manager' (9b4e8282-0029-4439-a093-f474cb50c723) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:55:57 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-0dd79ce9-7a2d-4075-a152-b71ef4d12601 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Created volume successfully. Sep 07 13:55:57 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:55:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Flow 'volume_create_manager' (b247bd99-152e-45f9-af40-cadd70b0cfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:55:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75a0530-8e8e-4fd2-9553-ca168f3e1930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75a0530-8e8e-4fd2-9553-ca168f3e1930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1731513339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf481d89-6500-405a-bf6a-9f250cbeef1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540d948240e146c8b5f708872330baad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:57Z,use_quota=True,user_id='0907543ffe9d406f80271558e5276e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c01340-fe8e-4ece-a1c0-a9c59afe16af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c01340-fe8e-4ece-a1c0-a9c59afe16af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85446072-e74f-4f95-acc7-4ca17a985c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85446072-e74f-4f95-acc7-4ca17a985c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf481d89-6500-405a-bf6a-9f250cbeef1c', 'volume_name': 'volume-bf481d89-6500-405a-bf6a-9f250cbeef1c', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702a5a7c-53ed-49bd-b685-14c848b39983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702a5a7c-53ed-49bd-b685-14c848b39983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37bb28d5-917f-4dff-b18d-146372ff88b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:57 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Volume bf481d89-6500-405a-bf6a-9f250cbeef1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf481d89-6500-405a-bf6a-9f250cbeef1c', 'volume_size': 1} Sep 07 13:55:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:57 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:55:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Flow 'volume_create_manager' (5975c5ca-0a74-49af-8947-dce8d52743de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:55:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b3aa63f-3cbb-46f9-aeda-4b6d9e876684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b3aa63f-3cbb-46f9-aeda-4b6d9e876684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-595039019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c44cbd7c-ddae-4eec-8c88-78e4d645accb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51bdebdf74c2407a8705ee5b0fe2575d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:57Z,use_quota=True,user_id='b5f46dee27fa41e5a9bd7e54deee7ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b8711f-7c24-469e-8e50-4e7b997a4982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b8711f-7c24-469e-8e50-4e7b997a4982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50f47cf5-1ba4-4017-9a27-2520208a2959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50f47cf5-1ba4-4017-9a27-2520208a2959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c44cbd7c-ddae-4eec-8c88-78e4d645accb', 'volume_name': 'volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949840d5-3e4a-4eec-a8cc-7308b21cb97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949840d5-3e4a-4eec-a8cc-7308b21cb97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7871c218-257e-485c-a4c5-189c5b8c19ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:58 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Volume c44cbd7c-ddae-4eec-8c88-78e4d645accb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb', 'volume_size': 1} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Flow 'volume_create_manager' (6537ba45-7ab7-476e-aed6-ee752403ced1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27cfebcf-e01d-4fc3-a5b2-bdc11b1a23dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:58 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b01e010e-3e30-46cf-81ea-1a711563aca7 1073741824" returned: 0 in 1.185s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27cfebcf-e01d-4fc3-a5b2-bdc11b1a23dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1214732302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed072d2b-a834-4b1a-9737-f2401e77c1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540d948240e146c8b5f708872330baad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:58Z,use_quota=True,user_id='0907543ffe9d406f80271558e5276e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21aee8f-98e0-4344-b2e5-032be4affda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21aee8f-98e0-4344-b2e5-032be4affda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9782ff28-74ce-42ed-8cd3-565040540ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9782ff28-74ce-42ed-8cd3-565040540ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed072d2b-a834-4b1a-9737-f2401e77c1f0', 'volume_name': 'volume-ed072d2b-a834-4b1a-9737-f2401e77c1f0', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27449a3f-a595-43c7-b1c1-0d2d96a86546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27449a3f-a595-43c7-b1c1-0d2d96a86546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3ddf5e-89a6-4527-96fd-4489a492125c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:58 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Volume ed072d2b-a834-4b1a-9737-f2401e77c1f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed072d2b-a834-4b1a-9737-f2401e77c1f0', 'volume_size': 1} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b01e010e-3e30-46cf-81ea-1a711563aca7 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:58 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b01e010e-3e30-46cf-81ea-1a711563aca7 Sep 07 13:55:58 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:55:58 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Flow 'volume_create_manager' (a2386fea-0f77-426e-b3e8-c31c8c7ada1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687d6066-a026-485d-910c-df7688fbf55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b01e010e-3e30-46cf-81ea-1a711563aca7" returned: 0 in 0.572s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.016s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1731513339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf481d89-6500-405a-bf6a-9f250cbeef1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540d948240e146c8b5f708872330baad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:57Z,use_quota=True,user_id='0907543ffe9d406f80271558e5276e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Creating volume bf481d89-6500-405a-bf6a-9f250cbeef1c {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:55:58 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf481d89-6500-405a-bf6a-9f250cbeef1c 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687d6066-a026-485d-910c-df7688fbf55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1622321089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4e8da2-d4ce-44e3-8ebf-0750594cee2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540d948240e146c8b5f708872330baad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:59Z,use_quota=True,user_id='0907543ffe9d406f80271558e5276e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:58 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf481d89-6500-405a-bf6a-9f250cbeef1c 1073741824 Sep 07 13:55:58 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789d6a3a-d4cd-4d12-ab66-fa1157f2189f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789d6a3a-d4cd-4d12-ab66-fa1157f2189f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (430359be-0ad6-4a9c-9f3e-e276ea4baa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (430359be-0ad6-4a9c-9f3e-e276ea4baa53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc4e8da2-d4ce-44e3-8ebf-0750594cee2d', 'volume_name': 'volume-fc4e8da2-d4ce-44e3-8ebf-0750594cee2d', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a2e1a8-b8ca-42b8-a071-3b9e14ac3c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a2e1a8-b8ca-42b8-a071-3b9e14ac3c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a79a21-826a-4de5-aca7-4667b4ec538e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:58 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Volume fc4e8da2-d4ce-44e3-8ebf-0750594cee2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc4e8da2-d4ce-44e3-8ebf-0750594cee2d', 'volume_size': 1} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f7804e-8717-4660-9a83-ac0124b7a242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b01e010e-3e30-46cf-81ea-1a711563aca7', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00102d16-ad15-46f9-9e0f-1f6c1c027a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:58 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Volume volume-b01e010e-3e30-46cf-81ea-1a711563aca7 (b01e010e-3e30-46cf-81ea-1a711563aca7): created successfully Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00102d16-ad15-46f9-9e0f-1f6c1c027a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Flow 'volume_create_manager' (a26aa60e-a344-41d3-baf3-2d766595bb20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:55:59 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-111f7afa-bdb6-4178-838f-c1b965896bfa tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Created volume successfully. Sep 07 13:55:59 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf481d89-6500-405a-bf6a-9f250cbeef1c 1073741824" returned: 0 in 0.736s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf481d89-6500-405a-bf6a-9f250cbeef1c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:59 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf481d89-6500-405a-bf6a-9f250cbeef1c Sep 07 13:55:59 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:59 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf481d89-6500-405a-bf6a-9f250cbeef1c" returned: 0 in 0.342s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:59 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:55:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.901s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:59 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-595039019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c44cbd7c-ddae-4eec-8c88-78e4d645accb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51bdebdf74c2407a8705ee5b0fe2575d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:57Z,use_quota=True,user_id='b5f46dee27fa41e5a9bd7e54deee7ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:55:59 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Creating volume c44cbd7c-ddae-4eec-8c88-78e4d645accb {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:55:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:59 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:59 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:59 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:55:59 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:55:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:59 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37bb28d5-917f-4dff-b18d-146372ff88b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf481d89-6500-405a-bf6a-9f250cbeef1c', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:59 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f946f1-e4bf-4f5e-83ef-5da78b29fe9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:00 devstack sudo[102095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb 1073741824 Sep 07 13:56:00 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:00 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Volume volume-bf481d89-6500-405a-bf6a-9f250cbeef1c (bf481d89-6500-405a-bf6a-9f250cbeef1c): created successfully Sep 07 13:56:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f946f1-e4bf-4f5e-83ef-5da78b29fe9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Flow 'volume_create_manager' (b247bd99-152e-45f9-af40-cadd70b0cfc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:00 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-b9f3acb1-5a12-48d5-8b24-8fe937dba6fb tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Created volume successfully. Sep 07 13:56:00 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb 1073741824" returned: 0 in 0.667s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:00 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb Sep 07 13:56:00 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:01 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb" returned: 0 in 0.500s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:56:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.040s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1214732302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed072d2b-a834-4b1a-9737-f2401e77c1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540d948240e146c8b5f708872330baad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:58Z,use_quota=True,user_id='0907543ffe9d406f80271558e5276e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:56:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Creating volume ed072d2b-a834-4b1a-9737-f2401e77c1f0 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:56:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:56:01 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:56:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ed072d2b-a834-4b1a-9737-f2401e77c1f0 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7871c218-257e-485c-a4c5-189c5b8c19ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926f37eb-1485-4806-a82e-6c262f8ef666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:01 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ed072d2b-a834-4b1a-9737-f2401e77c1f0 1073741824 Sep 07 13:56:01 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:01 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Volume volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb (c44cbd7c-ddae-4eec-8c88-78e4d645accb): created successfully Sep 07 13:56:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926f37eb-1485-4806-a82e-6c262f8ef666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Flow 'volume_create_manager' (5975c5ca-0a74-49af-8947-dce8d52743de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:01 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-acf5a747-f5a7-4f85-ad1d-6eb151e0dd3d tempest-TestStampPattern-1657532424 None] Created volume successfully. Sep 07 13:56:02 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ed072d2b-a834-4b1a-9737-f2401e77c1f0 1073741824" returned: 0 in 0.908s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ed072d2b-a834-4b1a-9737-f2401e77c1f0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:02 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ed072d2b-a834-4b1a-9737-f2401e77c1f0 Sep 07 13:56:02 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:02 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ed072d2b-a834-4b1a-9737-f2401e77c1f0" returned: 0 in 0.285s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:56:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.565s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1622321089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4e8da2-d4ce-44e3-8ebf-0750594cee2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540d948240e146c8b5f708872330baad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:59Z,use_quota=True,user_id='0907543ffe9d406f80271558e5276e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:56:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Creating volume fc4e8da2-d4ce-44e3-8ebf-0750594cee2d {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:56:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:56:02 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:56:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc4e8da2-d4ce-44e3-8ebf-0750594cee2d 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3ddf5e-89a6-4527-96fd-4489a492125c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed072d2b-a834-4b1a-9737-f2401e77c1f0', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3391c47f-f2ed-495a-89c8-06af3e6bcf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:02 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc4e8da2-d4ce-44e3-8ebf-0750594cee2d 1073741824 Sep 07 13:56:02 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Volume volume-ed072d2b-a834-4b1a-9737-f2401e77c1f0 (ed072d2b-a834-4b1a-9737-f2401e77c1f0): created successfully Sep 07 13:56:02 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3391c47f-f2ed-495a-89c8-06af3e6bcf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Flow 'volume_create_manager' (6537ba45-7ab7-476e-aed6-ee752403ced1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:02 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-35b01fcb-f9ae-462a-8ecc-136ad966b500 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Created volume successfully. Sep 07 13:56:02 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-d8fbb6f1-0fbd-4114-8c21-f6b9bc547975 req-3762b341-72ca-4abd-ac9e-460e012b33d2 tempest-TestInstancesWithCinderVolumes-1271306196 None] Terminate volume connection completed successfully. Sep 07 13:56:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-d8fbb6f1-0fbd-4114-8c21-f6b9bc547975 req-3762b341-72ca-4abd-ac9e-460e012b33d2 tempest-TestInstancesWithCinderVolumes-1271306196 None] Deleting attachment a1b04704-c68b-4626-9aa6-c972cb325120. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:56:03 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-da13ed9b-5ec8-46ed-a2db-47ef9c515972 tempest-TestInstancesWithCinderVolumes-1271306196 None] Acquiring lock "cinder-9edd4a1f-074b-4a33-894c-32ebe2aee79e-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:03 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-da13ed9b-5ec8-46ed-a2db-47ef9c515972 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "cinder-9edd4a1f-074b-4a33-894c-32ebe2aee79e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:03 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-da13ed9b-5ec8-46ed-a2db-47ef9c515972 tempest-TestInstancesWithCinderVolumes-1271306196 None] Acquiring lock "cinder-quobyte-9edd4a1f-074b-4a33-894c-32ebe2aee79e" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:03 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-da13ed9b-5ec8-46ed-a2db-47ef9c515972 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "cinder-quobyte-9edd4a1f-074b-4a33-894c-32ebe2aee79e" acquired by "delete_volume" :: waited 0.026s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:03 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc4e8da2-d4ce-44e3-8ebf-0750594cee2d 1073741824" returned: 0 in 0.943s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:03 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b40c070-9edc-4493-85e3-d81762b9dec7]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-da13ed9b-5ec8-46ed-a2db-47ef9c515972 tempest-TestInstancesWithCinderVolumes-1271306196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9edd4a1f-074b-4a33-894c-32ebe2aee79e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc4e8da2-d4ce-44e3-8ebf-0750594cee2d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:03 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc4e8da2-d4ce-44e3-8ebf-0750594cee2d Sep 07 13:56:03 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:03 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9edd4a1f-074b-4a33-894c-32ebe2aee79e Sep 07 13:56:03 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:03 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc4e8da2-d4ce-44e3-8ebf-0750594cee2d" returned: 0 in 0.312s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:03 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:56:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a79a21-826a-4de5-aca7-4667b4ec538e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc4e8da2-d4ce-44e3-8ebf-0750594cee2d', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16fce8ee-e2c9-4c6c-a490-81a46d157890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:03 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Volume volume-fc4e8da2-d4ce-44e3-8ebf-0750594cee2d (fc4e8da2-d4ce-44e3-8ebf-0750594cee2d): created successfully Sep 07 13:56:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16fce8ee-e2c9-4c6c-a490-81a46d157890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Flow 'volume_create_manager' (a2386fea-0f77-426e-b3e8-c31c8c7ada1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:03 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-915dbdbc-2734-40c6-a22b-c4524b440e9e tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Created volume successfully. Sep 07 13:56:03 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-da13ed9b-5ec8-46ed-a2db-47ef9c515972 tempest-TestInstancesWithCinderVolumes-1271306196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9edd4a1f-074b-4a33-894c-32ebe2aee79e" returned: 0 in 0.522s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-da13ed9b-5ec8-46ed-a2db-47ef9c515972 tempest-TestInstancesWithCinderVolumes-1271306196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9edd4a1f-074b-4a33-894c-32ebe2aee79e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:04 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9edd4a1f-074b-4a33-894c-32ebe2aee79e Sep 07 13:56:04 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:04 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-da13ed9b-5ec8-46ed-a2db-47ef9c515972 tempest-TestInstancesWithCinderVolumes-1271306196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9edd4a1f-074b-4a33-894c-32ebe2aee79e" returned: 0 in 0.323s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-da13ed9b-5ec8-46ed-a2db-47ef9c515972 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "cinder-quobyte-9edd4a1f-074b-4a33-894c-32ebe2aee79e" released by "delete_volume" :: held 0.895s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:04 devstack cinder-volume[87571]: WARNING cinder.quota [None req-da13ed9b-5ec8-46ed-a2db-47ef9c515972 tempest-TestInstancesWithCinderVolumes-1271306196 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-129211796-465155914 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-129211796-465155914, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:56:04 devstack cinder-volume[87571]: WARNING cinder.quota [None req-da13ed9b-5ec8-46ed-a2db-47ef9c515972 tempest-TestInstancesWithCinderVolumes-1271306196 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-129211796-465155914 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-129211796-465155914, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:56:04 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-da13ed9b-5ec8-46ed-a2db-47ef9c515972 tempest-TestInstancesWithCinderVolumes-1271306196 None] Created reservations ['caae21a1-2866-4d46-91fb-a4bd97dceaaf', 'ebf74fcf-82d1-4265-8793-6bc6013756cb', '4b24ecdd-6835-4b3f-be24-a92645b17722', '2e2e7108-f8df-43ec-8548-31945a57a1a5'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-da13ed9b-5ec8-46ed-a2db-47ef9c515972 tempest-TestInstancesWithCinderVolumes-1271306196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-da13ed9b-5ec8-46ed-a2db-47ef9c515972 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-da13ed9b-5ec8-46ed-a2db-47ef9c515972 tempest-TestInstancesWithCinderVolumes-1271306196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-da13ed9b-5ec8-46ed-a2db-47ef9c515972 tempest-TestInstancesWithCinderVolumes-1271306196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-da13ed9b-5ec8-46ed-a2db-47ef9c515972 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-da13ed9b-5ec8-46ed-a2db-47ef9c515972 tempest-TestInstancesWithCinderVolumes-1271306196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a4e516fc-1cf7-4acd-b6a8-f009da19a3ef tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "cinder-fc4e8da2-d4ce-44e3-8ebf-0750594cee2d-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:04 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:56:04 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a4e516fc-1cf7-4acd-b6a8-f009da19a3ef tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-fc4e8da2-d4ce-44e3-8ebf-0750594cee2d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a4e516fc-1cf7-4acd-b6a8-f009da19a3ef tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "cinder-quobyte-fc4e8da2-d4ce-44e3-8ebf-0750594cee2d" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a4e516fc-1cf7-4acd-b6a8-f009da19a3ef tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-quobyte-fc4e8da2-d4ce-44e3-8ebf-0750594cee2d" acquired by "delete_volume" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:04 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ec61f6-fad3-4dd2-95c6-91042358dede]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a4e516fc-1cf7-4acd-b6a8-f009da19a3ef tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc4e8da2-d4ce-44e3-8ebf-0750594cee2d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:04 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc4e8da2-d4ce-44e3-8ebf-0750594cee2d Sep 07 13:56:04 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:04 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-da13ed9b-5ec8-46ed-a2db-47ef9c515972 tempest-TestInstancesWithCinderVolumes-1271306196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.395s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:04 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-da13ed9b-5ec8-46ed-a2db-47ef9c515972 tempest-TestInstancesWithCinderVolumes-1271306196 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:04 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-da13ed9b-5ec8-46ed-a2db-47ef9c515972 tempest-TestInstancesWithCinderVolumes-1271306196 None] Deleted volume successfully. Sep 07 13:56:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-da13ed9b-5ec8-46ed-a2db-47ef9c515972 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "cinder-9edd4a1f-074b-4a33-894c-32ebe2aee79e-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:05 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a4e516fc-1cf7-4acd-b6a8-f009da19a3ef tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc4e8da2-d4ce-44e3-8ebf-0750594cee2d" returned: 0 in 0.461s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a4e516fc-1cf7-4acd-b6a8-f009da19a3ef tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc4e8da2-d4ce-44e3-8ebf-0750594cee2d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:05 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc4e8da2-d4ce-44e3-8ebf-0750594cee2d Sep 07 13:56:05 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:05 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a4e516fc-1cf7-4acd-b6a8-f009da19a3ef tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc4e8da2-d4ce-44e3-8ebf-0750594cee2d" returned: 0 in 0.293s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a4e516fc-1cf7-4acd-b6a8-f009da19a3ef tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-quobyte-fc4e8da2-d4ce-44e3-8ebf-0750594cee2d" released by "delete_volume" :: held 0.814s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:05 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-a4e516fc-1cf7-4acd-b6a8-f009da19a3ef tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Created reservations ['13a5ea2d-d2a7-41ef-96ac-d65466b7b9ce', '1efd4e62-cd6b-4317-beec-7ee6f6cb069f', 'a3785669-3f66-4f68-81a3-589ad278a1f1', '48f3f380-2d9a-416a-a7da-aad370cae2b4'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a4e516fc-1cf7-4acd-b6a8-f009da19a3ef tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a4e516fc-1cf7-4acd-b6a8-f009da19a3ef tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a4e516fc-1cf7-4acd-b6a8-f009da19a3ef tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a4e516fc-1cf7-4acd-b6a8-f009da19a3ef tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a4e516fc-1cf7-4acd-b6a8-f009da19a3ef tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a4e516fc-1cf7-4acd-b6a8-f009da19a3ef tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:05 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:56:05 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-534452dd-0cfb-4553-9d2e-cbb99a011e0d tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "cinder-ed072d2b-a834-4b1a-9737-f2401e77c1f0-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-534452dd-0cfb-4553-9d2e-cbb99a011e0d tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-ed072d2b-a834-4b1a-9737-f2401e77c1f0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-534452dd-0cfb-4553-9d2e-cbb99a011e0d tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "cinder-quobyte-ed072d2b-a834-4b1a-9737-f2401e77c1f0" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-534452dd-0cfb-4553-9d2e-cbb99a011e0d tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-quobyte-ed072d2b-a834-4b1a-9737-f2401e77c1f0" acquired by "delete_volume" :: waited 0.059s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:06 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbf967e-511c-458f-95c3-6e8af249de94]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-534452dd-0cfb-4553-9d2e-cbb99a011e0d tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ed072d2b-a834-4b1a-9737-f2401e77c1f0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:06 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a4e516fc-1cf7-4acd-b6a8-f009da19a3ef tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.565s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:06 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-a4e516fc-1cf7-4acd-b6a8-f009da19a3ef tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:06 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-a4e516fc-1cf7-4acd-b6a8-f009da19a3ef tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Deleted volume successfully. Sep 07 13:56:06 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ed072d2b-a834-4b1a-9737-f2401e77c1f0 Sep 07 13:56:06 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a4e516fc-1cf7-4acd-b6a8-f009da19a3ef tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-fc4e8da2-d4ce-44e3-8ebf-0750594cee2d-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:06 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:06 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-534452dd-0cfb-4553-9d2e-cbb99a011e0d tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ed072d2b-a834-4b1a-9737-f2401e77c1f0" returned: 0 in 0.648s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-534452dd-0cfb-4553-9d2e-cbb99a011e0d tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ed072d2b-a834-4b1a-9737-f2401e77c1f0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:06 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ed072d2b-a834-4b1a-9737-f2401e77c1f0 Sep 07 13:56:06 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:07 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-534452dd-0cfb-4553-9d2e-cbb99a011e0d tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ed072d2b-a834-4b1a-9737-f2401e77c1f0" returned: 0 in 0.500s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:07 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-534452dd-0cfb-4553-9d2e-cbb99a011e0d tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-quobyte-ed072d2b-a834-4b1a-9737-f2401e77c1f0" released by "delete_volume" :: held 1.293s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:07 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-534452dd-0cfb-4553-9d2e-cbb99a011e0d tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Created reservations ['a3511113-2fec-4de0-964a-d5a663ce93b4', 'ff241af0-b9d2-43f4-8935-874c9483cde3', '96f85076-6025-4307-9afa-4b175f85d63b', '9fa39e8b-53d7-4cc7-8292-396facea29b2'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-534452dd-0cfb-4553-9d2e-cbb99a011e0d tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-534452dd-0cfb-4553-9d2e-cbb99a011e0d tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-534452dd-0cfb-4553-9d2e-cbb99a011e0d tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-534452dd-0cfb-4553-9d2e-cbb99a011e0d tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-534452dd-0cfb-4553-9d2e-cbb99a011e0d tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-534452dd-0cfb-4553-9d2e-cbb99a011e0d tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:07 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:56:07 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:07 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-534452dd-0cfb-4553-9d2e-cbb99a011e0d tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.281s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:07 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-534452dd-0cfb-4553-9d2e-cbb99a011e0d tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:07 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-534452dd-0cfb-4553-9d2e-cbb99a011e0d tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Deleted volume successfully. Sep 07 13:56:07 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-534452dd-0cfb-4553-9d2e-cbb99a011e0d tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-ed072d2b-a834-4b1a-9737-f2401e77c1f0-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-464fe774-b5f3-4671-a387-b7761ced1b12 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "cinder-bf481d89-6500-405a-bf6a-9f250cbeef1c-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:08 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-25f074d1-ec69-4deb-9c84-577ae7ad3e19 req-f1be56df-b1e2-4627-bfdc-9a337def4bfe tempest-TestInstancesWithCinderVolumes-1271306196 None] Terminate volume connection completed successfully. Sep 07 13:56:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-25f074d1-ec69-4deb-9c84-577ae7ad3e19 req-f1be56df-b1e2-4627-bfdc-9a337def4bfe tempest-TestInstancesWithCinderVolumes-1271306196 None] Deleting attachment b53157fa-5ca0-409b-aa3f-ab755a97ec74. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:56:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-464fe774-b5f3-4671-a387-b7761ced1b12 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-bf481d89-6500-405a-bf6a-9f250cbeef1c-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-464fe774-b5f3-4671-a387-b7761ced1b12 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "cinder-quobyte-bf481d89-6500-405a-bf6a-9f250cbeef1c" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-464fe774-b5f3-4671-a387-b7761ced1b12 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-quobyte-bf481d89-6500-405a-bf6a-9f250cbeef1c" acquired by "delete_volume" :: waited 0.028s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:08 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a574efc-488e-4776-88e1-40b11db13dcd]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-464fe774-b5f3-4671-a387-b7761ced1b12 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf481d89-6500-405a-bf6a-9f250cbeef1c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:08 devstack sudo[102350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf481d89-6500-405a-bf6a-9f250cbeef1c Sep 07 13:56:08 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6c18d14b-45aa-43ea-be13-4f4bf95e479c tempest-TestInstancesWithCinderVolumes-1271306196 None] Acquiring lock "cinder-abe3b582-413f-479e-98d1-902afcf9e57a-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6c18d14b-45aa-43ea-be13-4f4bf95e479c tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "cinder-abe3b582-413f-479e-98d1-902afcf9e57a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6c18d14b-45aa-43ea-be13-4f4bf95e479c tempest-TestInstancesWithCinderVolumes-1271306196 None] Acquiring lock "cinder-quobyte-abe3b582-413f-479e-98d1-902afcf9e57a" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6c18d14b-45aa-43ea-be13-4f4bf95e479c tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "cinder-quobyte-abe3b582-413f-479e-98d1-902afcf9e57a" acquired by "delete_volume" :: waited 0.036s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:09 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:09 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e09195-6428-4525-b3a8-d390b977a672]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6c18d14b-45aa-43ea-be13-4f4bf95e479c tempest-TestInstancesWithCinderVolumes-1271306196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abe3b582-413f-479e-98d1-902afcf9e57a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-464fe774-b5f3-4671-a387-b7761ced1b12 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf481d89-6500-405a-bf6a-9f250cbeef1c" returned: 0 in 0.635s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-464fe774-b5f3-4671-a387-b7761ced1b12 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf481d89-6500-405a-bf6a-9f250cbeef1c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:09 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf481d89-6500-405a-bf6a-9f250cbeef1c Sep 07 13:56:09 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:09 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abe3b582-413f-479e-98d1-902afcf9e57a Sep 07 13:56:09 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:09 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-464fe774-b5f3-4671-a387-b7761ced1b12 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bf481d89-6500-405a-bf6a-9f250cbeef1c" returned: 0 in 0.388s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-464fe774-b5f3-4671-a387-b7761ced1b12 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-quobyte-bf481d89-6500-405a-bf6a-9f250cbeef1c" released by "delete_volume" :: held 1.114s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:09 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-464fe774-b5f3-4671-a387-b7761ced1b12 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Created reservations ['41a0ee44-5958-47e0-945b-a5e267486f1a', '81ae204e-4e71-4889-9d56-3800882b9d5a', '8df16b50-df92-4333-9509-b840990fa7fe', '86397e90-1240-44a7-b3e9-ccc329ad82dd'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:09 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6c18d14b-45aa-43ea-be13-4f4bf95e479c tempest-TestInstancesWithCinderVolumes-1271306196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abe3b582-413f-479e-98d1-902afcf9e57a" returned: 0 in 0.723s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6c18d14b-45aa-43ea-be13-4f4bf95e479c tempest-TestInstancesWithCinderVolumes-1271306196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abe3b582-413f-479e-98d1-902afcf9e57a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-464fe774-b5f3-4671-a387-b7761ced1b12 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-464fe774-b5f3-4671-a387-b7761ced1b12 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:09 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abe3b582-413f-479e-98d1-902afcf9e57a Sep 07 13:56:09 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:09 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-464fe774-b5f3-4671-a387-b7761ced1b12 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:09 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-464fe774-b5f3-4671-a387-b7761ced1b12 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-464fe774-b5f3-4671-a387-b7761ced1b12 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-464fe774-b5f3-4671-a387-b7761ced1b12 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:09 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:56:09 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:10 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-464fe774-b5f3-4671-a387-b7761ced1b12 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.369s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:10 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-464fe774-b5f3-4671-a387-b7761ced1b12 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:10 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-464fe774-b5f3-4671-a387-b7761ced1b12 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Deleted volume successfully. Sep 07 13:56:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-464fe774-b5f3-4671-a387-b7761ced1b12 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-bf481d89-6500-405a-bf6a-9f250cbeef1c-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:10 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6c18d14b-45aa-43ea-be13-4f4bf95e479c tempest-TestInstancesWithCinderVolumes-1271306196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abe3b582-413f-479e-98d1-902afcf9e57a" returned: 0 in 0.551s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6c18d14b-45aa-43ea-be13-4f4bf95e479c tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "cinder-quobyte-abe3b582-413f-479e-98d1-902afcf9e57a" released by "delete_volume" :: held 1.353s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:10 devstack cinder-volume[87571]: WARNING cinder.quota [None req-6c18d14b-45aa-43ea-be13-4f4bf95e479c tempest-TestInstancesWithCinderVolumes-1271306196 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1450391208-923347502 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1450391208-923347502, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:56:10 devstack cinder-volume[87571]: WARNING cinder.quota [None req-6c18d14b-45aa-43ea-be13-4f4bf95e479c tempest-TestInstancesWithCinderVolumes-1271306196 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1450391208-923347502 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1450391208-923347502, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:56:10 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-6c18d14b-45aa-43ea-be13-4f4bf95e479c tempest-TestInstancesWithCinderVolumes-1271306196 None] Created reservations ['f5de207d-b162-4f89-8309-bfdc985e80de', '43da8b07-f77a-49e1-bd6f-bbf7ac82e31e', '0ca7cdde-bef5-41fa-b4e3-59cdaad5578f', 'fd2aef23-b01b-4737-bf19-8552d5cfdefc'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6c18d14b-45aa-43ea-be13-4f4bf95e479c tempest-TestInstancesWithCinderVolumes-1271306196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6c18d14b-45aa-43ea-be13-4f4bf95e479c tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-6c18d14b-45aa-43ea-be13-4f4bf95e479c tempest-TestInstancesWithCinderVolumes-1271306196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-6c18d14b-45aa-43ea-be13-4f4bf95e479c tempest-TestInstancesWithCinderVolumes-1271306196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6c18d14b-45aa-43ea-be13-4f4bf95e479c tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6c18d14b-45aa-43ea-be13-4f4bf95e479c tempest-TestInstancesWithCinderVolumes-1271306196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:10 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:56:10 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-00e6b7a8-9b04-4357-b0f3-79cc004b5236 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "cinder-b01e010e-3e30-46cf-81ea-1a711563aca7-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-00e6b7a8-9b04-4357-b0f3-79cc004b5236 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-b01e010e-3e30-46cf-81ea-1a711563aca7-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-00e6b7a8-9b04-4357-b0f3-79cc004b5236 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "cinder-quobyte-b01e010e-3e30-46cf-81ea-1a711563aca7" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-00e6b7a8-9b04-4357-b0f3-79cc004b5236 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-quobyte-b01e010e-3e30-46cf-81ea-1a711563aca7" acquired by "delete_volume" :: waited 0.059s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:11 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6c18d14b-45aa-43ea-be13-4f4bf95e479c tempest-TestInstancesWithCinderVolumes-1271306196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.495s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:11 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-6c18d14b-45aa-43ea-be13-4f4bf95e479c tempest-TestInstancesWithCinderVolumes-1271306196 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:11 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b090e469-f6d8-4cf7-9708-abe806d266a4]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-00e6b7a8-9b04-4357-b0f3-79cc004b5236 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b01e010e-3e30-46cf-81ea-1a711563aca7 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:11 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-6c18d14b-45aa-43ea-be13-4f4bf95e479c tempest-TestInstancesWithCinderVolumes-1271306196 None] Deleted volume successfully. Sep 07 13:56:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6c18d14b-45aa-43ea-be13-4f4bf95e479c tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "cinder-abe3b582-413f-479e-98d1-902afcf9e57a-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:11 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b01e010e-3e30-46cf-81ea-1a711563aca7 Sep 07 13:56:11 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:11 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-00e6b7a8-9b04-4357-b0f3-79cc004b5236 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b01e010e-3e30-46cf-81ea-1a711563aca7" returned: 0 in 0.516s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-00e6b7a8-9b04-4357-b0f3-79cc004b5236 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b01e010e-3e30-46cf-81ea-1a711563aca7 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:11 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b01e010e-3e30-46cf-81ea-1a711563aca7 Sep 07 13:56:11 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:12 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-00e6b7a8-9b04-4357-b0f3-79cc004b5236 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b01e010e-3e30-46cf-81ea-1a711563aca7" returned: 0 in 0.608s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-00e6b7a8-9b04-4357-b0f3-79cc004b5236 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-quobyte-b01e010e-3e30-46cf-81ea-1a711563aca7" released by "delete_volume" :: held 1.225s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:12 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-00e6b7a8-9b04-4357-b0f3-79cc004b5236 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Created reservations ['d844e69d-475c-4672-86b9-89d5c437d1b9', '64b62112-e321-4596-9fcd-e60b366a0502', '447148b9-c595-45ab-b215-c2686d63e428', 'cefcffc9-afca-4e53-b33c-0680c65ffcfe'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-00e6b7a8-9b04-4357-b0f3-79cc004b5236 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-00e6b7a8-9b04-4357-b0f3-79cc004b5236 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-00e6b7a8-9b04-4357-b0f3-79cc004b5236 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-00e6b7a8-9b04-4357-b0f3-79cc004b5236 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-00e6b7a8-9b04-4357-b0f3-79cc004b5236 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-00e6b7a8-9b04-4357-b0f3-79cc004b5236 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:12 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:56:12 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:13 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-00e6b7a8-9b04-4357-b0f3-79cc004b5236 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.409s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:13 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-00e6b7a8-9b04-4357-b0f3-79cc004b5236 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:13 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-00e6b7a8-9b04-4357-b0f3-79cc004b5236 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Deleted volume successfully. Sep 07 13:56:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-00e6b7a8-9b04-4357-b0f3-79cc004b5236 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-b01e010e-3e30-46cf-81ea-1a711563aca7-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-eb6903fc-72de-487b-895c-85c89b2cc9e9 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "cinder-bb11b418-a5ba-4179-8538-b6bff19b6ef0-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-eb6903fc-72de-487b-895c-85c89b2cc9e9 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-bb11b418-a5ba-4179-8538-b6bff19b6ef0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-eb6903fc-72de-487b-895c-85c89b2cc9e9 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "cinder-quobyte-bb11b418-a5ba-4179-8538-b6bff19b6ef0" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-eb6903fc-72de-487b-895c-85c89b2cc9e9 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-quobyte-bb11b418-a5ba-4179-8538-b6bff19b6ef0" acquired by "delete_volume" :: waited 0.053s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:13 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c1c0e2-293a-4601-be8e-d6f9b57616e6]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-eb6903fc-72de-487b-895c-85c89b2cc9e9 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bb11b418-a5ba-4179-8538-b6bff19b6ef0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:14 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bb11b418-a5ba-4179-8538-b6bff19b6ef0 Sep 07 13:56:14 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:14 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-eb6903fc-72de-487b-895c-85c89b2cc9e9 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bb11b418-a5ba-4179-8538-b6bff19b6ef0" returned: 0 in 0.802s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-eb6903fc-72de-487b-895c-85c89b2cc9e9 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bb11b418-a5ba-4179-8538-b6bff19b6ef0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:14 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bb11b418-a5ba-4179-8538-b6bff19b6ef0 Sep 07 13:56:14 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:14 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:56:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Flow 'volume_create_manager' (6b36e076-7fd0-443d-a1e7-6e4bb5dff42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30de3511-841d-40ed-811a-31b028edd0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30de3511-841d-40ed-811a-31b028edd0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-198330947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d60aac3-3291-4466-a67a-a574aa9e9a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6147a7e49abf47eda252408fb0741f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:15Z,use_quota=True,user_id='34aacec7b8284f38a711d350e4e44e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bae2f2b-f2a2-414f-bc8f-d288dd325613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bae2f2b-f2a2-414f-bc8f-d288dd325613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (657c715e-0638-47ac-a449-76fca6d00004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (657c715e-0638-47ac-a449-76fca6d00004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d60aac3-3291-4466-a67a-a574aa9e9a71', 'volume_name': 'volume-3d60aac3-3291-4466-a67a-a574aa9e9a71', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bacd436c-918e-4efb-918c-168abc7788f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bacd436c-918e-4efb-918c-168abc7788f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8516cba2-7160-44be-a31d-1ba8c214b823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:14 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Volume 3d60aac3-3291-4466-a67a-a574aa9e9a71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d60aac3-3291-4466-a67a-a574aa9e9a71', 'volume_size': 1} Sep 07 13:56:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-198330947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d60aac3-3291-4466-a67a-a574aa9e9a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6147a7e49abf47eda252408fb0741f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:15Z,use_quota=True,user_id='34aacec7b8284f38a711d350e4e44e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:56:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Creating volume 3d60aac3-3291-4466-a67a-a574aa9e9a71 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:56:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:56:15 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:56:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3d60aac3-3291-4466-a67a-a574aa9e9a71 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:15 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3d60aac3-3291-4466-a67a-a574aa9e9a71 1073741824 Sep 07 13:56:15 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:15 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-eb6903fc-72de-487b-895c-85c89b2cc9e9 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bb11b418-a5ba-4179-8538-b6bff19b6ef0" returned: 0 in 0.645s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-eb6903fc-72de-487b-895c-85c89b2cc9e9 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-quobyte-bb11b418-a5ba-4179-8538-b6bff19b6ef0" released by "delete_volume" :: held 1.553s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:15 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-eb6903fc-72de-487b-895c-85c89b2cc9e9 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Created reservations ['af53c93b-569d-408d-a789-0b2fd3e60382', '24d51fb2-cb44-4910-8fb2-f149b5523755', '3d7fed07-efeb-4708-a09d-de12d5a6d645', '8c687edc-5f70-4cf6-bf98-afea9cbcbcb4'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-eb6903fc-72de-487b-895c-85c89b2cc9e9 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-eb6903fc-72de-487b-895c-85c89b2cc9e9 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-eb6903fc-72de-487b-895c-85c89b2cc9e9 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-eb6903fc-72de-487b-895c-85c89b2cc9e9 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-eb6903fc-72de-487b-895c-85c89b2cc9e9 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-eb6903fc-72de-487b-895c-85c89b2cc9e9 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:15 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:56:15 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:15 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3d60aac3-3291-4466-a67a-a574aa9e9a71 1073741824" returned: 0 in 0.870s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3d60aac3-3291-4466-a67a-a574aa9e9a71 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:16 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3d60aac3-3291-4466-a67a-a574aa9e9a71 Sep 07 13:56:16 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:16 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fef9aa3f-ba72-47f9-8f23-3cd0ee204f39 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "cinder-600de248-ece5-4441-baa4-bc46c5d14374-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:16 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fef9aa3f-ba72-47f9-8f23-3cd0ee204f39 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-600de248-ece5-4441-baa4-bc46c5d14374-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:16 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fef9aa3f-ba72-47f9-8f23-3cd0ee204f39 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "cinder-quobyte-600de248-ece5-4441-baa4-bc46c5d14374" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:16 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fef9aa3f-ba72-47f9-8f23-3cd0ee204f39 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-quobyte-600de248-ece5-4441-baa4-bc46c5d14374" acquired by "delete_volume" :: waited 0.053s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:16 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[283855d2-8dfc-47bf-ad70-83473c2ad892]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fef9aa3f-ba72-47f9-8f23-3cd0ee204f39 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-600de248-ece5-4441-baa4-bc46c5d14374 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:16 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-eb6903fc-72de-487b-895c-85c89b2cc9e9 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 1.034s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:16 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-eb6903fc-72de-487b-895c-85c89b2cc9e9 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:16 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-eb6903fc-72de-487b-895c-85c89b2cc9e9 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Deleted volume successfully. Sep 07 13:56:16 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-eb6903fc-72de-487b-895c-85c89b2cc9e9 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-bb11b418-a5ba-4179-8538-b6bff19b6ef0-delete_volume" released by "delete_volume" :: held 3.204s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:16 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3d60aac3-3291-4466-a67a-a574aa9e9a71" returned: 0 in 0.989s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:56:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8516cba2-7160-44be-a31d-1ba8c214b823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d60aac3-3291-4466-a67a-a574aa9e9a71', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c54162-f504-449b-b389-73dfea0ea08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:17 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Volume volume-3d60aac3-3291-4466-a67a-a574aa9e9a71 (3d60aac3-3291-4466-a67a-a574aa9e9a71): created successfully Sep 07 13:56:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c54162-f504-449b-b389-73dfea0ea08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Flow 'volume_create_manager' (6b36e076-7fd0-443d-a1e7-6e4bb5dff42a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:17 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-4061021d-ad7c-40be-876a-46ace3a9f844 tempest-AttachVolumeNegativeTest-470973352 None] Created volume successfully. Sep 07 13:56:17 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-600de248-ece5-4441-baa4-bc46c5d14374 Sep 07 13:56:17 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:17 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fef9aa3f-ba72-47f9-8f23-3cd0ee204f39 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-600de248-ece5-4441-baa4-bc46c5d14374" returned: 0 in 0.908s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fef9aa3f-ba72-47f9-8f23-3cd0ee204f39 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-600de248-ece5-4441-baa4-bc46c5d14374 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:17 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-600de248-ece5-4441-baa4-bc46c5d14374 Sep 07 13:56:17 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:18 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fef9aa3f-ba72-47f9-8f23-3cd0ee204f39 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-600de248-ece5-4441-baa4-bc46c5d14374" returned: 0 in 0.584s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fef9aa3f-ba72-47f9-8f23-3cd0ee204f39 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-quobyte-600de248-ece5-4441-baa4-bc46c5d14374" released by "delete_volume" :: held 1.664s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:18 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-fef9aa3f-ba72-47f9-8f23-3cd0ee204f39 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Created reservations ['5d669331-bb39-4bfe-9ceb-1b6aa193ae7d', 'ec8d617d-347e-48fb-b991-adf377a4d1e0', '6c593bf4-a5f2-4345-94b2-85d3f0b6a76a', '742fb3cd-4856-4991-a4ef-c658b662fa17'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fef9aa3f-ba72-47f9-8f23-3cd0ee204f39 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fef9aa3f-ba72-47f9-8f23-3cd0ee204f39 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fef9aa3f-ba72-47f9-8f23-3cd0ee204f39 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fef9aa3f-ba72-47f9-8f23-3cd0ee204f39 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fef9aa3f-ba72-47f9-8f23-3cd0ee204f39 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fef9aa3f-ba72-47f9-8f23-3cd0ee204f39 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:18 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:56:18 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:19 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-a1ab675c-d79f-4326-a1e8-8eabdbc6a339 req-024b2b38-2c80-4be3-9777-8917d0cac218 tempest-TestInstancesWithCinderVolumes-1271306196 None] Terminate volume connection completed successfully. Sep 07 13:56:19 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-a1ab675c-d79f-4326-a1e8-8eabdbc6a339 req-024b2b38-2c80-4be3-9777-8917d0cac218 tempest-TestInstancesWithCinderVolumes-1271306196 None] Deleting attachment 6445d40a-1173-4334-b289-c93ad0d015d0. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:56:19 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fef9aa3f-ba72-47f9-8f23-3cd0ee204f39 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.839s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:19 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-fef9aa3f-ba72-47f9-8f23-3cd0ee204f39 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:19 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-fef9aa3f-ba72-47f9-8f23-3cd0ee204f39 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Deleted volume successfully. Sep 07 13:56:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-fef9aa3f-ba72-47f9-8f23-3cd0ee204f39 tempest-CreateVolumesFromSourceVolumeTest-1151409446 None] Lock "cinder-600de248-ece5-4441-baa4-bc46c5d14374-delete_volume" released by "delete_volume" :: held 3.062s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-2acde6e7-1765-4d10-853f-b0e33e2c8243 req-6a390784-0e2e-4a7a-b0b2-abccfa0c7693 tempest-AttachVolumeNegativeTest-470973352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-2acde6e7-1765-4d10-853f-b0e33e2c8243 req-6a390784-0e2e-4a7a-b0b2-abccfa0c7693 tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-2acde6e7-1765-4d10-853f-b0e33e2c8243 req-6a390784-0e2e-4a7a-b0b2-abccfa0c7693 tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:19 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-2acde6e7-1765-4d10-853f-b0e33e2c8243 req-6a390784-0e2e-4a7a-b0b2-abccfa0c7693 tempest-AttachVolumeNegativeTest-470973352 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285', 'name': 'volume-3d60aac3-3291-4466-a67a-a574aa9e9a71', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be150227-8509-4b4b-bbec-e0aa08df7553', 'enforce_multipath': True} {{(pid=87571) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:56:19 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-2acde6e7-1765-4d10-853f-b0e33e2c8243 req-6a390784-0e2e-4a7a-b0b2-abccfa0c7693 tempest-AttachVolumeNegativeTest-470973352 None] attachment_update completed successfully. Sep 07 13:56:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5ac440db-127b-4c49-a7bf-2ad16dc34c05 tempest-TestInstancesWithCinderVolumes-1271306196 None] Acquiring lock "cinder-e7841aae-14eb-4c3e-9638-5c76856673ac-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5ac440db-127b-4c49-a7bf-2ad16dc34c05 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "cinder-e7841aae-14eb-4c3e-9638-5c76856673ac-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5ac440db-127b-4c49-a7bf-2ad16dc34c05 tempest-TestInstancesWithCinderVolumes-1271306196 None] Acquiring lock "cinder-quobyte-e7841aae-14eb-4c3e-9638-5c76856673ac" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5ac440db-127b-4c49-a7bf-2ad16dc34c05 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "cinder-quobyte-e7841aae-14eb-4c3e-9638-5c76856673ac" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:20 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b504b276-0802-43fe-a513-d8a5ce6c1232]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5ac440db-127b-4c49-a7bf-2ad16dc34c05 tempest-TestInstancesWithCinderVolumes-1271306196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e7841aae-14eb-4c3e-9638-5c76856673ac {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:20 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e7841aae-14eb-4c3e-9638-5c76856673ac Sep 07 13:56:20 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:21 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5ac440db-127b-4c49-a7bf-2ad16dc34c05 tempest-TestInstancesWithCinderVolumes-1271306196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e7841aae-14eb-4c3e-9638-5c76856673ac" returned: 0 in 0.669s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5ac440db-127b-4c49-a7bf-2ad16dc34c05 tempest-TestInstancesWithCinderVolumes-1271306196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e7841aae-14eb-4c3e-9638-5c76856673ac {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:21 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e7841aae-14eb-4c3e-9638-5c76856673ac Sep 07 13:56:21 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:21 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5ac440db-127b-4c49-a7bf-2ad16dc34c05 tempest-TestInstancesWithCinderVolumes-1271306196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e7841aae-14eb-4c3e-9638-5c76856673ac" returned: 0 in 0.355s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5ac440db-127b-4c49-a7bf-2ad16dc34c05 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "cinder-quobyte-e7841aae-14eb-4c3e-9638-5c76856673ac" released by "delete_volume" :: held 1.082s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:21 devstack cinder-volume[87571]: WARNING cinder.quota [None req-5ac440db-127b-4c49-a7bf-2ad16dc34c05 tempest-TestInstancesWithCinderVolumes-1271306196 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1844887303-1454398021 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1844887303-1454398021, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:56:21 devstack cinder-volume[87571]: WARNING cinder.quota [None req-5ac440db-127b-4c49-a7bf-2ad16dc34c05 tempest-TestInstancesWithCinderVolumes-1271306196 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1844887303-1454398021 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1844887303-1454398021, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:56:21 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-5ac440db-127b-4c49-a7bf-2ad16dc34c05 tempest-TestInstancesWithCinderVolumes-1271306196 None] Created reservations ['94ab53b4-78b4-46b8-b948-f28a060434d7', 'c5aa3253-e99a-4377-a20d-a92338181da1', '0ec64381-7cc2-4c57-a0a1-b0a89ac1d712', '2f97d542-4921-4e44-ae96-08d81a30c1fc'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5ac440db-127b-4c49-a7bf-2ad16dc34c05 tempest-TestInstancesWithCinderVolumes-1271306196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5ac440db-127b-4c49-a7bf-2ad16dc34c05 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5ac440db-127b-4c49-a7bf-2ad16dc34c05 tempest-TestInstancesWithCinderVolumes-1271306196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5ac440db-127b-4c49-a7bf-2ad16dc34c05 tempest-TestInstancesWithCinderVolumes-1271306196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5ac440db-127b-4c49-a7bf-2ad16dc34c05 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5ac440db-127b-4c49-a7bf-2ad16dc34c05 tempest-TestInstancesWithCinderVolumes-1271306196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:21 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:56:21 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:21 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5ac440db-127b-4c49-a7bf-2ad16dc34c05 tempest-TestInstancesWithCinderVolumes-1271306196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.281s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:21 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-5ac440db-127b-4c49-a7bf-2ad16dc34c05 tempest-TestInstancesWithCinderVolumes-1271306196 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:21 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-5ac440db-127b-4c49-a7bf-2ad16dc34c05 tempest-TestInstancesWithCinderVolumes-1271306196 None] Deleted volume successfully. Sep 07 13:56:22 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5ac440db-127b-4c49-a7bf-2ad16dc34c05 tempest-TestInstancesWithCinderVolumes-1271306196 None] Lock "cinder-e7841aae-14eb-4c3e-9638-5c76856673ac-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:22 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-ce652246-85af-4e60-b76d-005f9a57d794 req-46004d16-c6db-428a-b856-d9417f07995b tempest-AttachVolumeNegativeTest-470973352 None] Terminate volume connection completed successfully. Sep 07 13:56:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-ce652246-85af-4e60-b76d-005f9a57d794 req-46004d16-c6db-428a-b856-d9417f07995b tempest-AttachVolumeNegativeTest-470973352 None] Deleting attachment be150227-8509-4b4b-bbec-e0aa08df7553. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:56:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:56:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:28 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:56:28 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:28 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.388s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager._thread_info {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:56:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread count: 28 {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:56:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread info: [<_MainThread(MainThread, started 132147689414784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:56:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-15d641c9-4411-493c-b5f9-66b5b9608c50 tempest-AttachVolumeNegativeTest-470973352 None] Acquiring lock "cinder-3d60aac3-3291-4466-a67a-a574aa9e9a71-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-15d641c9-4411-493c-b5f9-66b5b9608c50 tempest-AttachVolumeNegativeTest-470973352 None] Lock "cinder-3d60aac3-3291-4466-a67a-a574aa9e9a71-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-15d641c9-4411-493c-b5f9-66b5b9608c50 tempest-AttachVolumeNegativeTest-470973352 None] Acquiring lock "cinder-quobyte-3d60aac3-3291-4466-a67a-a574aa9e9a71" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-15d641c9-4411-493c-b5f9-66b5b9608c50 tempest-AttachVolumeNegativeTest-470973352 None] Lock "cinder-quobyte-3d60aac3-3291-4466-a67a-a574aa9e9a71" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:28 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffc2a33-5975-48a4-8f2e-ab4be69a9a45]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-15d641c9-4411-493c-b5f9-66b5b9608c50 tempest-AttachVolumeNegativeTest-470973352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3d60aac3-3291-4466-a67a-a574aa9e9a71 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:29 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3d60aac3-3291-4466-a67a-a574aa9e9a71 Sep 07 13:56:29 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:29 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-15d641c9-4411-493c-b5f9-66b5b9608c50 tempest-AttachVolumeNegativeTest-470973352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3d60aac3-3291-4466-a67a-a574aa9e9a71" returned: 0 in 0.528s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-15d641c9-4411-493c-b5f9-66b5b9608c50 tempest-AttachVolumeNegativeTest-470973352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3d60aac3-3291-4466-a67a-a574aa9e9a71 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:29 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3d60aac3-3291-4466-a67a-a574aa9e9a71 Sep 07 13:56:29 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:29 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-15d641c9-4411-493c-b5f9-66b5b9608c50 tempest-AttachVolumeNegativeTest-470973352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3d60aac3-3291-4466-a67a-a574aa9e9a71" returned: 0 in 0.333s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-15d641c9-4411-493c-b5f9-66b5b9608c50 tempest-AttachVolumeNegativeTest-470973352 None] Lock "cinder-quobyte-3d60aac3-3291-4466-a67a-a574aa9e9a71" released by "delete_volume" :: held 0.936s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:29 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-15d641c9-4411-493c-b5f9-66b5b9608c50 tempest-AttachVolumeNegativeTest-470973352 None] Created reservations ['a19e0a4f-3648-426b-866d-dd9c1f3aa77b', '4b4f30f6-8bcb-4e66-bcd3-7cfc0be56565', '5a352f61-60e8-47eb-ad01-d339b43ced9b', '32616edb-3e0a-4e47-832d-9547790340a0'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-15d641c9-4411-493c-b5f9-66b5b9608c50 tempest-AttachVolumeNegativeTest-470973352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-15d641c9-4411-493c-b5f9-66b5b9608c50 tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-15d641c9-4411-493c-b5f9-66b5b9608c50 tempest-AttachVolumeNegativeTest-470973352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-15d641c9-4411-493c-b5f9-66b5b9608c50 tempest-AttachVolumeNegativeTest-470973352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-15d641c9-4411-493c-b5f9-66b5b9608c50 tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-15d641c9-4411-493c-b5f9-66b5b9608c50 tempest-AttachVolumeNegativeTest-470973352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:30 devstack sudo[102944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:56:30 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:30 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-15d641c9-4411-493c-b5f9-66b5b9608c50 tempest-AttachVolumeNegativeTest-470973352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.278s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:30 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-15d641c9-4411-493c-b5f9-66b5b9608c50 tempest-AttachVolumeNegativeTest-470973352 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:30 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-15d641c9-4411-493c-b5f9-66b5b9608c50 tempest-AttachVolumeNegativeTest-470973352 None] Deleted volume successfully. Sep 07 13:56:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-15d641c9-4411-493c-b5f9-66b5b9608c50 tempest-AttachVolumeNegativeTest-470973352 None] Lock "cinder-3d60aac3-3291-4466-a67a-a574aa9e9a71-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:31 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-baaa1927-2276-497b-b4b2-7d0e06417186 tempest-AttachVolumeNegativeTest-470973352 None] Acquiring lock "cinder-deb55ae3-f644-42fe-b8e2-96d1443d7085-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:31 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-baaa1927-2276-497b-b4b2-7d0e06417186 tempest-AttachVolumeNegativeTest-470973352 None] Lock "cinder-deb55ae3-f644-42fe-b8e2-96d1443d7085-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:31 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-baaa1927-2276-497b-b4b2-7d0e06417186 tempest-AttachVolumeNegativeTest-470973352 None] Acquiring lock "cinder-quobyte-deb55ae3-f644-42fe-b8e2-96d1443d7085" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:31 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-baaa1927-2276-497b-b4b2-7d0e06417186 tempest-AttachVolumeNegativeTest-470973352 None] Lock "cinder-quobyte-deb55ae3-f644-42fe-b8e2-96d1443d7085" acquired by "delete_volume" :: waited 0.026s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:31 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8059732d-d95b-4679-9fd6-6ba34bde16bc]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-baaa1927-2276-497b-b4b2-7d0e06417186 tempest-AttachVolumeNegativeTest-470973352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-deb55ae3-f644-42fe-b8e2-96d1443d7085 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:31 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-deb55ae3-f644-42fe-b8e2-96d1443d7085 Sep 07 13:56:31 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:31 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-baaa1927-2276-497b-b4b2-7d0e06417186 tempest-AttachVolumeNegativeTest-470973352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-deb55ae3-f644-42fe-b8e2-96d1443d7085" returned: 0 in 0.411s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-baaa1927-2276-497b-b4b2-7d0e06417186 tempest-AttachVolumeNegativeTest-470973352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-deb55ae3-f644-42fe-b8e2-96d1443d7085 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:31 devstack sudo[102953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-deb55ae3-f644-42fe-b8e2-96d1443d7085 Sep 07 13:56:31 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:32 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-baaa1927-2276-497b-b4b2-7d0e06417186 tempest-AttachVolumeNegativeTest-470973352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-deb55ae3-f644-42fe-b8e2-96d1443d7085" returned: 0 in 0.267s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-baaa1927-2276-497b-b4b2-7d0e06417186 tempest-AttachVolumeNegativeTest-470973352 None] Lock "cinder-quobyte-deb55ae3-f644-42fe-b8e2-96d1443d7085" released by "delete_volume" :: held 0.731s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:32 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-baaa1927-2276-497b-b4b2-7d0e06417186 tempest-AttachVolumeNegativeTest-470973352 None] Created reservations ['27e62cb9-08dd-4dea-9428-45964f55e3c4', '846c07f5-0709-4b00-bb4e-f4b5910cad66', 'b14f3210-34d8-41eb-ae3e-bfb480d4b20b', '1968f828-c8f8-4768-b16a-e600f5745a54'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-baaa1927-2276-497b-b4b2-7d0e06417186 tempest-AttachVolumeNegativeTest-470973352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-baaa1927-2276-497b-b4b2-7d0e06417186 tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-baaa1927-2276-497b-b4b2-7d0e06417186 tempest-AttachVolumeNegativeTest-470973352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-baaa1927-2276-497b-b4b2-7d0e06417186 tempest-AttachVolumeNegativeTest-470973352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-baaa1927-2276-497b-b4b2-7d0e06417186 tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-baaa1927-2276-497b-b4b2-7d0e06417186 tempest-AttachVolumeNegativeTest-470973352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:32 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:56:32 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:32 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-baaa1927-2276-497b-b4b2-7d0e06417186 tempest-AttachVolumeNegativeTest-470973352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.310s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:32 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-baaa1927-2276-497b-b4b2-7d0e06417186 tempest-AttachVolumeNegativeTest-470973352 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:32 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-baaa1927-2276-497b-b4b2-7d0e06417186 tempest-AttachVolumeNegativeTest-470973352 None] Deleted volume successfully. Sep 07 13:56:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-baaa1927-2276-497b-b4b2-7d0e06417186 tempest-AttachVolumeNegativeTest-470973352 None] Lock "cinder-deb55ae3-f644-42fe-b8e2-96d1443d7085-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9dc284de-acca-479c-a8b1-b5db04e9df37 tempest-AttachVolumeNegativeTest-470973352 None] Acquiring lock "cinder-6b4e4b76-4587-4f38-aa1c-b0f8e3548c36-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9dc284de-acca-479c-a8b1-b5db04e9df37 tempest-AttachVolumeNegativeTest-470973352 None] Lock "cinder-6b4e4b76-4587-4f38-aa1c-b0f8e3548c36-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9dc284de-acca-479c-a8b1-b5db04e9df37 tempest-AttachVolumeNegativeTest-470973352 None] Acquiring lock "cinder-quobyte-6b4e4b76-4587-4f38-aa1c-b0f8e3548c36" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9dc284de-acca-479c-a8b1-b5db04e9df37 tempest-AttachVolumeNegativeTest-470973352 None] Lock "cinder-quobyte-6b4e4b76-4587-4f38-aa1c-b0f8e3548c36" acquired by "delete_volume" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:32 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a624e4-aac8-4326-8976-30ca228e3d3a]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9dc284de-acca-479c-a8b1-b5db04e9df37 tempest-AttachVolumeNegativeTest-470973352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6b4e4b76-4587-4f38-aa1c-b0f8e3548c36 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:32 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6b4e4b76-4587-4f38-aa1c-b0f8e3548c36 Sep 07 13:56:32 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:33 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9dc284de-acca-479c-a8b1-b5db04e9df37 tempest-AttachVolumeNegativeTest-470973352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6b4e4b76-4587-4f38-aa1c-b0f8e3548c36" returned: 0 in 0.494s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9dc284de-acca-479c-a8b1-b5db04e9df37 tempest-AttachVolumeNegativeTest-470973352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6b4e4b76-4587-4f38-aa1c-b0f8e3548c36 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:33 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6b4e4b76-4587-4f38-aa1c-b0f8e3548c36 Sep 07 13:56:33 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:33 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9dc284de-acca-479c-a8b1-b5db04e9df37 tempest-AttachVolumeNegativeTest-470973352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6b4e4b76-4587-4f38-aa1c-b0f8e3548c36" returned: 0 in 0.250s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9dc284de-acca-479c-a8b1-b5db04e9df37 tempest-AttachVolumeNegativeTest-470973352 None] Lock "cinder-quobyte-6b4e4b76-4587-4f38-aa1c-b0f8e3548c36" released by "delete_volume" :: held 0.786s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:33 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-9dc284de-acca-479c-a8b1-b5db04e9df37 tempest-AttachVolumeNegativeTest-470973352 None] Created reservations ['06d8d1b1-9349-4bde-b9cc-89fec03b6910', 'c1a151be-7828-4bf2-a370-7dae224c6ed5', '8f8ac7f1-bed5-4153-b3ca-2b02e153b5ff', '5651547d-e8c3-4feb-99a5-9050215a190c'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9dc284de-acca-479c-a8b1-b5db04e9df37 tempest-AttachVolumeNegativeTest-470973352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9dc284de-acca-479c-a8b1-b5db04e9df37 tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9dc284de-acca-479c-a8b1-b5db04e9df37 tempest-AttachVolumeNegativeTest-470973352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9dc284de-acca-479c-a8b1-b5db04e9df37 tempest-AttachVolumeNegativeTest-470973352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9dc284de-acca-479c-a8b1-b5db04e9df37 tempest-AttachVolumeNegativeTest-470973352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9dc284de-acca-479c-a8b1-b5db04e9df37 tempest-AttachVolumeNegativeTest-470973352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:33 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:56:33 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:33 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9dc284de-acca-479c-a8b1-b5db04e9df37 tempest-AttachVolumeNegativeTest-470973352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.272s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:33 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-9dc284de-acca-479c-a8b1-b5db04e9df37 tempest-AttachVolumeNegativeTest-470973352 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:33 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-9dc284de-acca-479c-a8b1-b5db04e9df37 tempest-AttachVolumeNegativeTest-470973352 None] Deleted volume successfully. Sep 07 13:56:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9dc284de-acca-479c-a8b1-b5db04e9df37 tempest-AttachVolumeNegativeTest-470973352 None] Lock "cinder-6b4e4b76-4587-4f38-aa1c-b0f8e3548c36-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-c31151c8-3b86-4749-bb83-cbbc44057070 req-e0a3bcd0-6fcf-4ef2-a0d8-d25a81813238 tempest-TestStampPattern-1657532424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-c31151c8-3b86-4749-bb83-cbbc44057070 req-e0a3bcd0-6fcf-4ef2-a0d8-d25a81813238 tempest-TestStampPattern-1657532424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-c31151c8-3b86-4749-bb83-cbbc44057070 req-e0a3bcd0-6fcf-4ef2-a0d8-d25a81813238 tempest-TestStampPattern-1657532424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-c31151c8-3b86-4749-bb83-cbbc44057070 req-e0a3bcd0-6fcf-4ef2-a0d8-d25a81813238 tempest-TestStampPattern-1657532424 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285', 'name': 'volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '327ca37f-774a-449f-9f67-fcf87df7df2b', 'enforce_multipath': True} {{(pid=87571) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:56:36 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-c31151c8-3b86-4749-bb83-cbbc44057070 req-e0a3bcd0-6fcf-4ef2-a0d8-d25a81813238 tempest-TestStampPattern-1657532424 None] attachment_update completed successfully. Sep 07 13:56:38 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:56:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Flow 'volume_create_manager' (61bd8944-2e15-4312-b97f-b851f561e639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3add72-5e0b-41ed-8f1c-e26ef1d7a7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3add72-5e0b-41ed-8f1c-e26ef1d7a7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e7b291-39c5-42db-a1b6-99ab3b8b0e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f72620d67c44c3584ea5f8fe81dc59c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:39Z,use_quota=True,user_id='5101c1efc0204c89879d1569d8dae818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7cd21d-e0b2-45cf-8c67-9e76dbde82c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7cd21d-e0b2-45cf-8c67-9e76dbde82c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66b612d-4729-425c-a6f0-b0c28889eef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66b612d-4729-425c-a6f0-b0c28889eef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32e7b291-39c5-42db-a1b6-99ab3b8b0e94', 'volume_name': 'volume-32e7b291-39c5-42db-a1b6-99ab3b8b0e94', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c33198e-00b5-4d74-874b-d7630bb72750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c33198e-00b5-4d74-874b-d7630bb72750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a6edf8b-7ae2-4bc4-bc93-f8cec7c36999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:39 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Volume 32e7b291-39c5-42db-a1b6-99ab3b8b0e94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32e7b291-39c5-42db-a1b6-99ab3b8b0e94', 'volume_size': 1} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e7b291-39c5-42db-a1b6-99ab3b8b0e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f72620d67c44c3584ea5f8fe81dc59c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:39Z,use_quota=True,user_id='5101c1efc0204c89879d1569d8dae818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Creating volume 32e7b291-39c5-42db-a1b6-99ab3b8b0e94 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:56:39 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-32e7b291-39c5-42db-a1b6-99ab3b8b0e94 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:39 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-32e7b291-39c5-42db-a1b6-99ab3b8b0e94 1073741824 Sep 07 13:56:39 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:39 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-32e7b291-39c5-42db-a1b6-99ab3b8b0e94 1073741824" returned: 0 in 0.490s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-32e7b291-39c5-42db-a1b6-99ab3b8b0e94 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:39 devstack sudo[103391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-32e7b291-39c5-42db-a1b6-99ab3b8b0e94 Sep 07 13:56:39 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:39 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-32e7b291-39c5-42db-a1b6-99ab3b8b0e94" returned: 0 in 0.308s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a6edf8b-7ae2-4bc4-bc93-f8cec7c36999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32e7b291-39c5-42db-a1b6-99ab3b8b0e94', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf186e4-829c-4685-a65c-5fe162fab98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:39 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Volume volume-32e7b291-39c5-42db-a1b6-99ab3b8b0e94 (32e7b291-39c5-42db-a1b6-99ab3b8b0e94): created successfully Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf186e4-829c-4685-a65c-5fe162fab98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Flow 'volume_create_manager' (61bd8944-2e15-4312-b97f-b851f561e639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:39 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-4f2084f9-65e3-4f63-a2f5-0f1dc4f7cdab tempest-CinderUnicodeTest-1100465943 None] Created volume successfully. Sep 07 13:56:41 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:56:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Flow 'volume_create_manager' (c7595928-64a5-45e7-9206-54670c717311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c46bdc69-7e24-4893-8968-a685310cbd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c46bdc69-7e24-4893-8968-a685310cbd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-384248646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4b5511-ce69-4e81-99a1-e9b0f502f312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f72620d67c44c3584ea5f8fe81dc59c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:42Z,use_quota=True,user_id='5101c1efc0204c89879d1569d8dae818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4554463e-f1a5-4310-b8c9-968b1c8c53ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4554463e-f1a5-4310-b8c9-968b1c8c53ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8a1619-51ae-4223-a690-fc26735c3ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8a1619-51ae-4223-a690-fc26735c3ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df4b5511-ce69-4e81-99a1-e9b0f502f312', 'volume_name': 'volume-df4b5511-ce69-4e81-99a1-e9b0f502f312', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75f39dfe-a276-4227-a335-cf9d39e42af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75f39dfe-a276-4227-a335-cf9d39e42af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82daf1e4-3caf-4014-a91e-4d8948446a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:41 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Volume df4b5511-ce69-4e81-99a1-e9b0f502f312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df4b5511-ce69-4e81-99a1-e9b0f502f312', 'volume_size': 1} Sep 07 13:56:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:41 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-384248646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4b5511-ce69-4e81-99a1-e9b0f502f312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f72620d67c44c3584ea5f8fe81dc59c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:42Z,use_quota=True,user_id='5101c1efc0204c89879d1569d8dae818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:56:41 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Creating volume df4b5511-ce69-4e81-99a1-e9b0f502f312 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:56:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:41 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:41 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:41 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:56:41 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:56:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:41 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312 1073741824 Sep 07 13:56:41 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:41 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-eaeaf048-5421-4903-8f98-115baea2ab4c req-8a867861-3dff-459c-90d1-ff4a58a9cb12 tempest-TestStampPattern-1657532424 None] Terminate volume connection completed successfully. Sep 07 13:56:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-eaeaf048-5421-4903-8f98-115baea2ab4c req-8a867861-3dff-459c-90d1-ff4a58a9cb12 tempest-TestStampPattern-1657532424 None] Deleting attachment 327ca37f-774a-449f-9f67-fcf87df7df2b. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:56:42 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312 1073741824" returned: 0 in 0.518s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:42 devstack sudo[103438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312 Sep 07 13:56:42 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:42 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312" returned: 0 in 0.245s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82daf1e4-3caf-4014-a91e-4d8948446a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df4b5511-ce69-4e81-99a1-e9b0f502f312', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f3aab3d-8020-4261-a696-70bd0368cbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:42 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Volume volume-df4b5511-ce69-4e81-99a1-e9b0f502f312 (df4b5511-ce69-4e81-99a1-e9b0f502f312): created successfully Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f3aab3d-8020-4261-a696-70bd0368cbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Flow 'volume_create_manager' (c7595928-64a5-45e7-9206-54670c717311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:42 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-26a11f97-f95d-467c-824a-c627ce2dfda9 tempest-CinderUnicodeTest-1100465943 None] Created volume successfully. Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Flow 'volume_create_manager' (ad636dd6-6bb1-4f96-9027-6e272f5de451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5a0b3c-69a5-48ae-a031-2c62e9091a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5a0b3c-69a5-48ae-a031-2c62e9091a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-92148289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bcea32b-be79-4b5f-af77-410ed53aeedf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1686edc61bcc4abebb29bd9227b4aaba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:43Z,use_quota=True,user_id='2853234625ef4917bd289a590694ce56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77155911-a744-43f9-875b-d02083a12b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77155911-a744-43f9-875b-d02083a12b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5ca21c-9217-4e7a-92a5-ec50e9fefed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5ca21c-9217-4e7a-92a5-ec50e9fefed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bcea32b-be79-4b5f-af77-410ed53aeedf', 'volume_name': 'volume-6bcea32b-be79-4b5f-af77-410ed53aeedf', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1145cd5c-2084-4178-984a-44cb022837a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1145cd5c-2084-4178-984a-44cb022837a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c8f51f7-2691-47f5-91d0-7cb15f09aa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:42 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Volume 6bcea32b-be79-4b5f-af77-410ed53aeedf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bcea32b-be79-4b5f-af77-410ed53aeedf', 'volume_size': 1} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-92148289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bcea32b-be79-4b5f-af77-410ed53aeedf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1686edc61bcc4abebb29bd9227b4aaba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:43Z,use_quota=True,user_id='2853234625ef4917bd289a590694ce56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Creating volume 6bcea32b-be79-4b5f-af77-410ed53aeedf {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:56:42 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6bcea32b-be79-4b5f-af77-410ed53aeedf 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:42 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6bcea32b-be79-4b5f-af77-410ed53aeedf 1073741824 Sep 07 13:56:42 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fe1cc82d-42f6-44c1-95ef-a7f58227b13b tempest-TestStampPattern-1657532424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:43 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6bcea32b-be79-4b5f-af77-410ed53aeedf 1073741824" returned: 0 in 0.411s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:43 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=107,cinder:UPDATE=148,cinder:DELETE=13,cinder:INSERT=26 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:56:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6bcea32b-be79-4b5f-af77-410ed53aeedf {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:43 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6bcea32b-be79-4b5f-af77-410ed53aeedf Sep 07 13:56:43 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:43 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6bcea32b-be79-4b5f-af77-410ed53aeedf" returned: 0 in 0.235s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:56:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fe1cc82d-42f6-44c1-95ef-a7f58227b13b tempest-TestStampPattern-1657532424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.646s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-fe1cc82d-42f6-44c1-95ef-a7f58227b13b tempest-TestStampPattern-1657532424 None] Creating offline snapshot 1c9f7c55-8a0c-400f-98f9-f7cdd3259d71 of volume c44cbd7c-ddae-4eec-8c88-78e4d645accb {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:56:43 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c8f51f7-2691-47f5-91d0-7cb15f09aa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bcea32b-be79-4b5f-af77-410ed53aeedf', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:43 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a21a4f7-6921-4b22-8c7a-463153751b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:43 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a34f19-eb54-4355-80b9-6c5222ca211b]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fe1cc82d-42f6-44c1-95ef-a7f58227b13b tempest-TestStampPattern-1657532424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:43 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Volume volume-6bcea32b-be79-4b5f-af77-410ed53aeedf (6bcea32b-be79-4b5f-af77-410ed53aeedf): created successfully Sep 07 13:56:43 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a21a4f7-6921-4b22-8c7a-463153751b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:43 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Flow 'volume_create_manager' (ad636dd6-6bb1-4f96-9027-6e272f5de451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:43 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-b31ce1cb-272c-4140-9278-566f5d25463d tempest-VolumesTestJSON-767263321 None] Created volume successfully. Sep 07 13:56:43 devstack sudo[103449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb Sep 07 13:56:43 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:43 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=120,cinder:UPDATE=123,cinder:INSERT=33,cinder:DELETE=10 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:56:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9c90183c-c121-4b6e-9971-12ab93a48211 tempest-CinderUnicodeTest-1100465943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:44 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fe1cc82d-42f6-44c1-95ef-a7f58227b13b tempest-TestStampPattern-1657532424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb" returned: 0 in 0.416s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fe1cc82d-42f6-44c1-95ef-a7f58227b13b tempest-TestStampPattern-1657532424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.1c9f7c55-8a0c-400f-98f9-f7cdd3259d71 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:44 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.1c9f7c55-8a0c-400f-98f9-f7cdd3259d71 1G Sep 07 13:56:44 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:44 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:56:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Flow 'volume_create_manager' (6eebc292-ecdc-449a-94d5-78b338ddca1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f96b4d-c276-4de3-951e-199131d62876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:44 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f96b4d-c276-4de3-951e-199131d62876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-936595406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c86adcb9-ca3a-45af-987d-c03a05490ea5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1686edc61bcc4abebb29bd9227b4aaba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:44Z,use_quota=True,user_id='2853234625ef4917bd289a590694ce56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95fdba05-9bd0-4d17-802b-067863e36173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95fdba05-9bd0-4d17-802b-067863e36173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd52c281-f7a6-42a9-9df5-7e75fac46040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd52c281-f7a6-42a9-9df5-7e75fac46040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c86adcb9-ca3a-45af-987d-c03a05490ea5', 'volume_name': 'volume-c86adcb9-ca3a-45af-987d-c03a05490ea5', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ec5bbd-678a-49ff-ba8e-4d38bf25a252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ec5bbd-678a-49ff-ba8e-4d38bf25a252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6ff60b-99c0-47e2-87a3-b1e89069acb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:44 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Volume c86adcb9-ca3a-45af-987d-c03a05490ea5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c86adcb9-ca3a-45af-987d-c03a05490ea5', 'volume_size': 1} Sep 07 13:56:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fe1cc82d-42f6-44c1-95ef-a7f58227b13b tempest-TestStampPattern-1657532424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.1c9f7c55-8a0c-400f-98f9-f7cdd3259d71 1G" returned: 0 in 0.464s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fe1cc82d-42f6-44c1-95ef-a7f58227b13b tempest-TestStampPattern-1657532424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.1c9f7c55-8a0c-400f-98f9-f7cdd3259d71 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:44 devstack sudo[103460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.1c9f7c55-8a0c-400f-98f9-f7cdd3259d71 Sep 07 13:56:44 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:44 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fe1cc82d-42f6-44c1-95ef-a7f58227b13b tempest-TestStampPattern-1657532424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.1c9f7c55-8a0c-400f-98f9-f7cdd3259d71" returned: 0 in 0.268s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:44 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-fe1cc82d-42f6-44c1-95ef-a7f58227b13b tempest-TestStampPattern-1657532424 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.1c9f7c55-8a0c-400f-98f9-f7cdd3259d71 is being set with open permissions: ugo+rw Sep 07 13:56:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fe1cc82d-42f6-44c1-95ef-a7f58227b13b tempest-TestStampPattern-1657532424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.1c9f7c55-8a0c-400f-98f9-f7cdd3259d71 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:44 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.1c9f7c55-8a0c-400f-98f9-f7cdd3259d71 Sep 07 13:56:44 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:45 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fe1cc82d-42f6-44c1-95ef-a7f58227b13b tempest-TestStampPattern-1657532424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.1c9f7c55-8a0c-400f-98f9-f7cdd3259d71" returned: 0 in 0.271s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fe1cc82d-42f6-44c1-95ef-a7f58227b13b tempest-TestStampPattern-1657532424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:45 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.info Sep 07 13:56:45 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:45 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fe1cc82d-42f6-44c1-95ef-a7f58227b13b tempest-TestStampPattern-1657532424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.info" returned: 0 in 0.245s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:45 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-fe1cc82d-42f6-44c1-95ef-a7f58227b13b tempest-TestStampPattern-1657532424 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.info is being set with open permissions: ugo+rw Sep 07 13:56:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fe1cc82d-42f6-44c1-95ef-a7f58227b13b tempest-TestStampPattern-1657532424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:45 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.info Sep 07 13:56:45 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:45 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fe1cc82d-42f6-44c1-95ef-a7f58227b13b tempest-TestStampPattern-1657532424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.info" returned: 0 in 0.231s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fe1cc82d-42f6-44c1-95ef-a7f58227b13b tempest-TestStampPattern-1657532424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9c90183c-c121-4b6e-9971-12ab93a48211 tempest-CinderUnicodeTest-1100465943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.595s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:45 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-9c90183c-c121-4b6e-9971-12ab93a48211 tempest-CinderUnicodeTest-1100465943 None] Creating offline snapshot 8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a of volume df4b5511-ce69-4e81-99a1-e9b0f502f312 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:56:45 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-fe1cc82d-42f6-44c1-95ef-a7f58227b13b tempest-TestStampPattern-1657532424 None] Create snapshot completed successfully Sep 07 13:56:45 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d278a2-3f72-4211-87ab-4d36f6bf9d8d]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9c90183c-c121-4b6e-9971-12ab93a48211 tempest-CinderUnicodeTest-1100465943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:45 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312 Sep 07 13:56:45 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:45 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9c90183c-c121-4b6e-9971-12ab93a48211 tempest-CinderUnicodeTest-1100465943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312" returned: 0 in 0.338s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9c90183c-c121-4b6e-9971-12ab93a48211 tempest-CinderUnicodeTest-1100465943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:45 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a 1G Sep 07 13:56:45 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:46 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9c90183c-c121-4b6e-9971-12ab93a48211 tempest-CinderUnicodeTest-1100465943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a 1G" returned: 0 in 0.384s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9c90183c-c121-4b6e-9971-12ab93a48211 tempest-CinderUnicodeTest-1100465943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df4b5511-ce69-4e81-99a1-e9b0f502f312 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:46 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df4b5511-ce69-4e81-99a1-e9b0f502f312 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a Sep 07 13:56:46 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:46 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9c90183c-c121-4b6e-9971-12ab93a48211 tempest-CinderUnicodeTest-1100465943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df4b5511-ce69-4e81-99a1-e9b0f502f312 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a" returned: 0 in 0.287s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:46 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-9c90183c-c121-4b6e-9971-12ab93a48211 tempest-CinderUnicodeTest-1100465943 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a is being set with open permissions: ugo+rw Sep 07 13:56:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9c90183c-c121-4b6e-9971-12ab93a48211 tempest-CinderUnicodeTest-1100465943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:46 devstack sudo[103490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a Sep 07 13:56:46 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:46 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9c90183c-c121-4b6e-9971-12ab93a48211 tempest-CinderUnicodeTest-1100465943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a" returned: 0 in 0.241s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9c90183c-c121-4b6e-9971-12ab93a48211 tempest-CinderUnicodeTest-1100465943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:46 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.info Sep 07 13:56:46 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:47 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9c90183c-c121-4b6e-9971-12ab93a48211 tempest-CinderUnicodeTest-1100465943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.info" returned: 0 in 0.245s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:47 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-9c90183c-c121-4b6e-9971-12ab93a48211 tempest-CinderUnicodeTest-1100465943 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.info is being set with open permissions: ugo+rw Sep 07 13:56:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9c90183c-c121-4b6e-9971-12ab93a48211 tempest-CinderUnicodeTest-1100465943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:47 devstack sudo[103496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.info Sep 07 13:56:47 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:47 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9c90183c-c121-4b6e-9971-12ab93a48211 tempest-CinderUnicodeTest-1100465943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.info" returned: 0 in 0.264s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9c90183c-c121-4b6e-9971-12ab93a48211 tempest-CinderUnicodeTest-1100465943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.866s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.956s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-936595406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c86adcb9-ca3a-45af-987d-c03a05490ea5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1686edc61bcc4abebb29bd9227b4aaba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:44Z,use_quota=True,user_id='2853234625ef4917bd289a590694ce56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:56:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Creating volume c86adcb9-ca3a-45af-987d-c03a05490ea5 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:56:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:56:47 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:56:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c86adcb9-ca3a-45af-987d-c03a05490ea5 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:47 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c86adcb9-ca3a-45af-987d-c03a05490ea5 1073741824 Sep 07 13:56:47 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:47 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-9c90183c-c121-4b6e-9971-12ab93a48211 tempest-CinderUnicodeTest-1100465943 None] Create snapshot completed successfully Sep 07 13:56:47 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c86adcb9-ca3a-45af-987d-c03a05490ea5 1073741824" returned: 0 in 0.424s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c86adcb9-ca3a-45af-987d-c03a05490ea5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:47 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c86adcb9-ca3a-45af-987d-c03a05490ea5 Sep 07 13:56:47 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2ce1b4ae-1746-4a13-9ef1-d3c4c527a693 tempest-CinderUnicodeTest-1100465943 None] Acquiring lock "cinder-8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:48 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c86adcb9-ca3a-45af-987d-c03a05490ea5" returned: 0 in 0.256s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:56:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2ce1b4ae-1746-4a13-9ef1-d3c4c527a693 tempest-CinderUnicodeTest-1100465943 None] Lock "cinder-8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2ce1b4ae-1746-4a13-9ef1-d3c4c527a693 tempest-CinderUnicodeTest-1100465943 None] Acquiring lock "cinder-quobyte-df4b5511-ce69-4e81-99a1-e9b0f502f312" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6ff60b-99c0-47e2-87a3-b1e89069acb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c86adcb9-ca3a-45af-987d-c03a05490ea5', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7bb349-9bd1-4c70-84e2-b199ebf1c460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2ce1b4ae-1746-4a13-9ef1-d3c4c527a693 tempest-CinderUnicodeTest-1100465943 None] Lock "cinder-quobyte-df4b5511-ce69-4e81-99a1-e9b0f502f312" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2ce1b4ae-1746-4a13-9ef1-d3c4c527a693 tempest-CinderUnicodeTest-1100465943 None] Acquiring lock "cinder-quobyte-8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:48 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Volume volume-c86adcb9-ca3a-45af-987d-c03a05490ea5 (c86adcb9-ca3a-45af-987d-c03a05490ea5): created successfully Sep 07 13:56:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7bb349-9bd1-4c70-84e2-b199ebf1c460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Flow 'volume_create_manager' (6eebc292-ecdc-449a-94d5-78b338ddca1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2ce1b4ae-1746-4a13-9ef1-d3c4c527a693 tempest-CinderUnicodeTest-1100465943 None] Lock "cinder-quobyte-8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-2ce1b4ae-1746-4a13-9ef1-d3c4c527a693 tempest-CinderUnicodeTest-1100465943 None] Deleting offline snapshot 8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a of volume df4b5511-ce69-4e81-99a1-e9b0f502f312 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:56:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-2ce1b4ae-1746-4a13-9ef1-d3c4c527a693 tempest-CinderUnicodeTest-1100465943 None] snapshot_file for this snap is: volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:56:48 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-afe6dee7-4e58-4992-a77e-9f759000b1df tempest-VolumesTestJSON-767263321 None] Created volume successfully. Sep 07 13:56:48 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d623ad5-9bf1-4c9b-a978-4332e9e1aabc]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2ce1b4ae-1746-4a13-9ef1-d3c4c527a693 tempest-CinderUnicodeTest-1100465943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:48 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a Sep 07 13:56:48 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:48 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2ce1b4ae-1746-4a13-9ef1-d3c4c527a693 tempest-CinderUnicodeTest-1100465943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a" returned: 0 in 0.387s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-2ce1b4ae-1746-4a13-9ef1-d3c4c527a693 tempest-CinderUnicodeTest-1100465943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df4b5511-ce69-4e81-99a1-e9b0f502f312(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:56:48 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab0c1c4-1a26-47ca-bc46-dba487e60981]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2ce1b4ae-1746-4a13-9ef1-d3c4c527a693 tempest-CinderUnicodeTest-1100465943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:48 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312 Sep 07 13:56:48 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:49 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2ce1b4ae-1746-4a13-9ef1-d3c4c527a693 tempest-CinderUnicodeTest-1100465943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312" returned: 0 in 0.428s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2ce1b4ae-1746-4a13-9ef1-d3c4c527a693 tempest-CinderUnicodeTest-1100465943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:49 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a Sep 07 13:56:49 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Flow 'volume_create_manager' (134809b3-5894-480e-9482-4efcc9cfee85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e9482f-a1e2-4e9b-b7bb-f6a7204e5fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e9482f-a1e2-4e9b-b7bb-f6a7204e5fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-8803805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bcfa873-e480-4b7b-8a92-63edd02fefae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1686edc61bcc4abebb29bd9227b4aaba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:49Z,use_quota=True,user_id='2853234625ef4917bd289a590694ce56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb06dcf-9d87-4c39-8099-6cd301274e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb06dcf-9d87-4c39-8099-6cd301274e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad03734-6850-4673-afea-dae5e12e3f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad03734-6850-4673-afea-dae5e12e3f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bcfa873-e480-4b7b-8a92-63edd02fefae', 'volume_name': 'volume-3bcfa873-e480-4b7b-8a92-63edd02fefae', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf22e5f-427d-47eb-91bf-277cda520c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf22e5f-427d-47eb-91bf-277cda520c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48203654-80b7-406d-bb97-1c6627ad90de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:49 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Volume 3bcfa873-e480-4b7b-8a92-63edd02fefae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bcfa873-e480-4b7b-8a92-63edd02fefae', 'volume_size': 1} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-8803805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bcfa873-e480-4b7b-8a92-63edd02fefae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1686edc61bcc4abebb29bd9227b4aaba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:49Z,use_quota=True,user_id='2853234625ef4917bd289a590694ce56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Creating volume 3bcfa873-e480-4b7b-8a92-63edd02fefae {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:56:49 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3bcfa873-e480-4b7b-8a92-63edd02fefae 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:49 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3bcfa873-e480-4b7b-8a92-63edd02fefae 1073741824 Sep 07 13:56:49 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:49 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2ce1b4ae-1746-4a13-9ef1-d3c4c527a693 tempest-CinderUnicodeTest-1100465943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a" returned: 0 in 0.374s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2ce1b4ae-1746-4a13-9ef1-d3c4c527a693 tempest-CinderUnicodeTest-1100465943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:49 devstack sudo[103551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a Sep 07 13:56:49 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:49 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2ce1b4ae-1746-4a13-9ef1-d3c4c527a693 tempest-CinderUnicodeTest-1100465943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312.8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a" returned: 0 in 0.288s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:49 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3bcfa873-e480-4b7b-8a92-63edd02fefae 1073741824" returned: 0 in 0.487s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2ce1b4ae-1746-4a13-9ef1-d3c4c527a693 tempest-CinderUnicodeTest-1100465943 None] Lock "cinder-quobyte-8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a" released by "_delete_snapshot" :: held 1.602s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2ce1b4ae-1746-4a13-9ef1-d3c4c527a693 tempest-CinderUnicodeTest-1100465943 None] Lock "cinder-quobyte-df4b5511-ce69-4e81-99a1-e9b0f502f312" released by "delete_snapshot" :: held 1.640s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3bcfa873-e480-4b7b-8a92-63edd02fefae {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:49 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3bcfa873-e480-4b7b-8a92-63edd02fefae Sep 07 13:56:49 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:49 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-2ce1b4ae-1746-4a13-9ef1-d3c4c527a693 tempest-CinderUnicodeTest-1100465943 None] Created reservations ['095e8c06-4302-4b17-bf01-f327b506ef99', '55a21691-8ebf-484e-83e4-2485ca914b27', '52771187-ab3e-4735-b870-dd3dd443f610', '9fb1aac9-a570-4499-aa97-a1fbe0c88f8a'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:50 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-2ce1b4ae-1746-4a13-9ef1-d3c4c527a693 tempest-CinderUnicodeTest-1100465943 None] Delete snapshot completed successfully. Sep 07 13:56:50 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2ce1b4ae-1746-4a13-9ef1-d3c4c527a693 tempest-CinderUnicodeTest-1100465943 None] Lock "cinder-8e0132c0-0c49-4039-aaa5-a0a2b8c9f13a-delete_snapshot" released by "delete_snapshot" :: held 1.836s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:50 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3bcfa873-e480-4b7b-8a92-63edd02fefae" returned: 0 in 0.287s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:50 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:56:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48203654-80b7-406d-bb97-1c6627ad90de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bcfa873-e480-4b7b-8a92-63edd02fefae', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf19ac8-2bfa-489f-9351-fdf292ab0f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:50 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Volume volume-3bcfa873-e480-4b7b-8a92-63edd02fefae (3bcfa873-e480-4b7b-8a92-63edd02fefae): created successfully Sep 07 13:56:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf19ac8-2bfa-489f-9351-fdf292ab0f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Flow 'volume_create_manager' (134809b3-5894-480e-9482-4efcc9cfee85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:50 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-a27e376f-d46e-4d68-a724-8d92d7a5d949 tempest-VolumesTestJSON-767263321 None] Created volume successfully. Sep 07 13:56:50 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9a24fbcb-61b0-48ee-82b2-d94274c431c4 tempest-CinderUnicodeTest-1100465943 None] Acquiring lock "cinder-df4b5511-ce69-4e81-99a1-e9b0f502f312-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:50 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9a24fbcb-61b0-48ee-82b2-d94274c431c4 tempest-CinderUnicodeTest-1100465943 None] Lock "cinder-df4b5511-ce69-4e81-99a1-e9b0f502f312-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:50 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9a24fbcb-61b0-48ee-82b2-d94274c431c4 tempest-CinderUnicodeTest-1100465943 None] Acquiring lock "cinder-quobyte-df4b5511-ce69-4e81-99a1-e9b0f502f312" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:50 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9a24fbcb-61b0-48ee-82b2-d94274c431c4 tempest-CinderUnicodeTest-1100465943 None] Lock "cinder-quobyte-df4b5511-ce69-4e81-99a1-e9b0f502f312" acquired by "delete_volume" :: waited 0.013s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:50 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ecce7a-7f57-4169-b1c7-926e4caa20fd]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9a24fbcb-61b0-48ee-82b2-d94274c431c4 tempest-CinderUnicodeTest-1100465943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:50 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312 Sep 07 13:56:50 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:50 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9a24fbcb-61b0-48ee-82b2-d94274c431c4 tempest-CinderUnicodeTest-1100465943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312" returned: 0 in 0.375s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9a24fbcb-61b0-48ee-82b2-d94274c431c4 tempest-CinderUnicodeTest-1100465943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:50 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312 Sep 07 13:56:50 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:51 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9a24fbcb-61b0-48ee-82b2-d94274c431c4 tempest-CinderUnicodeTest-1100465943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-df4b5511-ce69-4e81-99a1-e9b0f502f312" returned: 0 in 0.250s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9a24fbcb-61b0-48ee-82b2-d94274c431c4 tempest-CinderUnicodeTest-1100465943 None] Lock "cinder-quobyte-df4b5511-ce69-4e81-99a1-e9b0f502f312" released by "delete_volume" :: held 0.689s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:51 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-9a24fbcb-61b0-48ee-82b2-d94274c431c4 tempest-CinderUnicodeTest-1100465943 None] Created reservations ['181fd5ac-3bea-4acb-88bc-7ae592b873c6', '9fb5c307-a152-45d8-8761-1d54c43c760a', '9d1d769b-b4c1-454f-a4cc-d86e86cb249e', 'fd362ebb-ad8f-4735-9bfb-3e7946fc7486'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9a24fbcb-61b0-48ee-82b2-d94274c431c4 tempest-CinderUnicodeTest-1100465943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9a24fbcb-61b0-48ee-82b2-d94274c431c4 tempest-CinderUnicodeTest-1100465943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9a24fbcb-61b0-48ee-82b2-d94274c431c4 tempest-CinderUnicodeTest-1100465943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9a24fbcb-61b0-48ee-82b2-d94274c431c4 tempest-CinderUnicodeTest-1100465943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9a24fbcb-61b0-48ee-82b2-d94274c431c4 tempest-CinderUnicodeTest-1100465943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9a24fbcb-61b0-48ee-82b2-d94274c431c4 tempest-CinderUnicodeTest-1100465943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:51 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:56:51 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-38583c94-8792-4010-9564-a5135a279e9d tempest-CinderUnicodeTest-1100465943 None] Acquiring lock "cinder-32e7b291-39c5-42db-a1b6-99ab3b8b0e94-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:51 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9a24fbcb-61b0-48ee-82b2-d94274c431c4 tempest-CinderUnicodeTest-1100465943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.324s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:51 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-9a24fbcb-61b0-48ee-82b2-d94274c431c4 tempest-CinderUnicodeTest-1100465943 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-38583c94-8792-4010-9564-a5135a279e9d tempest-CinderUnicodeTest-1100465943 None] Lock "cinder-32e7b291-39c5-42db-a1b6-99ab3b8b0e94-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:51 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-9a24fbcb-61b0-48ee-82b2-d94274c431c4 tempest-CinderUnicodeTest-1100465943 None] Deleted volume successfully. Sep 07 13:56:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-38583c94-8792-4010-9564-a5135a279e9d tempest-CinderUnicodeTest-1100465943 None] Acquiring lock "cinder-quobyte-32e7b291-39c5-42db-a1b6-99ab3b8b0e94" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9a24fbcb-61b0-48ee-82b2-d94274c431c4 tempest-CinderUnicodeTest-1100465943 None] Lock "cinder-df4b5511-ce69-4e81-99a1-e9b0f502f312-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-38583c94-8792-4010-9564-a5135a279e9d tempest-CinderUnicodeTest-1100465943 None] Lock "cinder-quobyte-32e7b291-39c5-42db-a1b6-99ab3b8b0e94" acquired by "delete_volume" :: waited 0.027s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:51 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b456b1-db54-422b-8b47-306a59c2db00]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-38583c94-8792-4010-9564-a5135a279e9d tempest-CinderUnicodeTest-1100465943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-32e7b291-39c5-42db-a1b6-99ab3b8b0e94 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:51 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-32e7b291-39c5-42db-a1b6-99ab3b8b0e94 Sep 07 13:56:51 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:52 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-38583c94-8792-4010-9564-a5135a279e9d tempest-CinderUnicodeTest-1100465943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-32e7b291-39c5-42db-a1b6-99ab3b8b0e94" returned: 0 in 0.381s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-38583c94-8792-4010-9564-a5135a279e9d tempest-CinderUnicodeTest-1100465943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-32e7b291-39c5-42db-a1b6-99ab3b8b0e94 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:52 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-32e7b291-39c5-42db-a1b6-99ab3b8b0e94 Sep 07 13:56:52 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5d1f0ee7-a428-4324-8655-1103d2f4259c tempest-VolumesTestJSON-767263321 None] Acquiring lock "cinder-3bcfa873-e480-4b7b-8a92-63edd02fefae-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5d1f0ee7-a428-4324-8655-1103d2f4259c tempest-VolumesTestJSON-767263321 None] Lock "cinder-3bcfa873-e480-4b7b-8a92-63edd02fefae-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5d1f0ee7-a428-4324-8655-1103d2f4259c tempest-VolumesTestJSON-767263321 None] Acquiring lock "cinder-quobyte-3bcfa873-e480-4b7b-8a92-63edd02fefae" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5d1f0ee7-a428-4324-8655-1103d2f4259c tempest-VolumesTestJSON-767263321 None] Lock "cinder-quobyte-3bcfa873-e480-4b7b-8a92-63edd02fefae" acquired by "delete_volume" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4da76e-bce9-49fd-bead-11d0721da3f6]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5d1f0ee7-a428-4324-8655-1103d2f4259c tempest-VolumesTestJSON-767263321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3bcfa873-e480-4b7b-8a92-63edd02fefae {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:52 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-38583c94-8792-4010-9564-a5135a279e9d tempest-CinderUnicodeTest-1100465943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-32e7b291-39c5-42db-a1b6-99ab3b8b0e94" returned: 0 in 0.265s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-38583c94-8792-4010-9564-a5135a279e9d tempest-CinderUnicodeTest-1100465943 None] Lock "cinder-quobyte-32e7b291-39c5-42db-a1b6-99ab3b8b0e94" released by "delete_volume" :: held 0.691s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-38583c94-8792-4010-9564-a5135a279e9d tempest-CinderUnicodeTest-1100465943 None] Created reservations ['1df4ae4a-f369-4aac-adab-24b722194625', '27032d8b-b16e-4015-8301-39f99408e9da', '70d239a0-a44d-411d-9ff6-104ed21340d3', '2416ad8c-f043-40c3-ae4a-a7348f92c139'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:52 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3bcfa873-e480-4b7b-8a92-63edd02fefae Sep 07 13:56:52 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-38583c94-8792-4010-9564-a5135a279e9d tempest-CinderUnicodeTest-1100465943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-38583c94-8792-4010-9564-a5135a279e9d tempest-CinderUnicodeTest-1100465943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-38583c94-8792-4010-9564-a5135a279e9d tempest-CinderUnicodeTest-1100465943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-38583c94-8792-4010-9564-a5135a279e9d tempest-CinderUnicodeTest-1100465943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-38583c94-8792-4010-9564-a5135a279e9d tempest-CinderUnicodeTest-1100465943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-38583c94-8792-4010-9564-a5135a279e9d tempest-CinderUnicodeTest-1100465943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:52 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:56:52 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:52 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-38583c94-8792-4010-9564-a5135a279e9d tempest-CinderUnicodeTest-1100465943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.271s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-38583c94-8792-4010-9564-a5135a279e9d tempest-CinderUnicodeTest-1100465943 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:52 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-38583c94-8792-4010-9564-a5135a279e9d tempest-CinderUnicodeTest-1100465943 None] Deleted volume successfully. Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-38583c94-8792-4010-9564-a5135a279e9d tempest-CinderUnicodeTest-1100465943 None] Lock "cinder-32e7b291-39c5-42db-a1b6-99ab3b8b0e94-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:52 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5d1f0ee7-a428-4324-8655-1103d2f4259c tempest-VolumesTestJSON-767263321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3bcfa873-e480-4b7b-8a92-63edd02fefae" returned: 0 in 0.544s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5d1f0ee7-a428-4324-8655-1103d2f4259c tempest-VolumesTestJSON-767263321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3bcfa873-e480-4b7b-8a92-63edd02fefae {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:52 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3bcfa873-e480-4b7b-8a92-63edd02fefae Sep 07 13:56:52 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Flow 'volume_create_manager' (cabe8c4f-4a48-4446-a21c-0de488ee9024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:52 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56238e1c-01dd-4216-bff6-0a33181fbf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56238e1c-01dd-4216-bff6-0a33181fbf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1257319941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a3b847-206f-4404-9638-f44a20c88a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51bdebdf74c2407a8705ee5b0fe2575d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1c9f7c55-8a0c-400f-98f9-f7cdd3259d71,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:53Z,use_quota=True,user_id='b5f46dee27fa41e5a9bd7e54deee7ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45bbe661-b827-4303-99a9-0581e74415df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45bbe661-b827-4303-99a9-0581e74415df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46bf664d-0b7d-41dc-a3f2-dbe589554ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46bf664d-0b7d-41dc-a3f2-dbe589554ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '60a3b847-206f-4404-9638-f44a20c88a62', 'volume_name': 'volume-60a3b847-206f-4404-9638-f44a20c88a62', 'volume_size': 1, 'snapshot_id': '1c9f7c55-8a0c-400f-98f9-f7cdd3259d71'}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (598a85cc-75bc-4f84-a191-9b683eda0978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (598a85cc-75bc-4f84-a191-9b683eda0978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ff90ce-a299-4ae6-a122-25b5b02abe2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:53 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Volume 60a3b847-206f-4404-9638-f44a20c88a62: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-60a3b847-206f-4404-9638-f44a20c88a62', 'volume_size': 1, 'snapshot_id': '1c9f7c55-8a0c-400f-98f9-f7cdd3259d71'} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Acquiring lock "cinder-quobyte-1c9f7c55-8a0c-400f-98f9-f7cdd3259d71-60a3b847-206f-4404-9638-f44a20c88a62" by "_create_volume_from_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Lock "cinder-quobyte-1c9f7c55-8a0c-400f-98f9-f7cdd3259d71-60a3b847-206f-4404-9638-f44a20c88a62" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Creating volume 60a3b847-206f-4404-9638-f44a20c88a62 from snapshot 1c9f7c55-8a0c-400f-98f9-f7cdd3259d71 {{(pid=87571) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Acquiring lock "cinder-quobyte-60a3b847-206f-4404-9638-f44a20c88a62" by "_copy_volume_from_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Lock "cinder-quobyte-60a3b847-206f-4404-9638-f44a20c88a62" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] snapshot: 1c9f7c55-8a0c-400f-98f9-f7cdd3259d71, volume: 60a3b847-206f-4404-9638-f44a20c88a62, {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2667b0-6979-49fb-af5f-4a9051755683]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.1c9f7c55-8a0c-400f-98f9-f7cdd3259d71 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:53 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5d1f0ee7-a428-4324-8655-1103d2f4259c tempest-VolumesTestJSON-767263321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3bcfa873-e480-4b7b-8a92-63edd02fefae" returned: 0 in 0.390s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5d1f0ee7-a428-4324-8655-1103d2f4259c tempest-VolumesTestJSON-767263321 None] Lock "cinder-quobyte-3bcfa873-e480-4b7b-8a92-63edd02fefae" released by "delete_volume" :: held 0.987s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:53 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.1c9f7c55-8a0c-400f-98f9-f7cdd3259d71 Sep 07 13:56:53 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-5d1f0ee7-a428-4324-8655-1103d2f4259c tempest-VolumesTestJSON-767263321 None] Created reservations ['3f1e16b9-98fc-490d-9ccf-1fffd4ab0d97', 'c2496d41-ecdc-4b94-bf7c-153311f70cce', '6ca09191-a8f0-42fc-9755-0dc9c79d09be', '7965c54b-86de-4a8d-a42f-2d5c45cd7811'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5d1f0ee7-a428-4324-8655-1103d2f4259c tempest-VolumesTestJSON-767263321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5d1f0ee7-a428-4324-8655-1103d2f4259c tempest-VolumesTestJSON-767263321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5d1f0ee7-a428-4324-8655-1103d2f4259c tempest-VolumesTestJSON-767263321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5d1f0ee7-a428-4324-8655-1103d2f4259c tempest-VolumesTestJSON-767263321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5d1f0ee7-a428-4324-8655-1103d2f4259c tempest-VolumesTestJSON-767263321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5d1f0ee7-a428-4324-8655-1103d2f4259c tempest-VolumesTestJSON-767263321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:53 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:56:53 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:53 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.1c9f7c55-8a0c-400f-98f9-f7cdd3259d71" returned: 0 in 0.522s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9678ba18-578f-4ad9-a46f-54d466925112]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:53 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5d1f0ee7-a428-4324-8655-1103d2f4259c tempest-VolumesTestJSON-767263321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.359s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-5d1f0ee7-a428-4324-8655-1103d2f4259c tempest-VolumesTestJSON-767263321 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:53 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-5d1f0ee7-a428-4324-8655-1103d2f4259c tempest-VolumesTestJSON-767263321 None] Deleted volume successfully. Sep 07 13:56:53 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5d1f0ee7-a428-4324-8655-1103d2f4259c tempest-VolumesTestJSON-767263321 None] Lock "cinder-3bcfa873-e480-4b7b-8a92-63edd02fefae-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:53 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb Sep 07 13:56:53 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:54 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb" returned: 0 in 0.494s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:54 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 13:56:54 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Creating direct copy from snapshot {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 13:56:54 devstack cinder-volume[87571]: DEBUG cinder.utils [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Path /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-60a3b847-206f-4404-9638-f44a20c88a62 not found in is_blk_device check {{(pid=87571) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 13:56:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-60a3b847-206f-4404-9638-f44a20c88a62 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:54 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-60a3b847-206f-4404-9638-f44a20c88a62 Sep 07 13:56:54 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1db1ffb3-3cb4-424f-81fa-34c313932fee tempest-VolumesTestJSON-767263321 None] Acquiring lock "cinder-c86adcb9-ca3a-45af-987d-c03a05490ea5-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1db1ffb3-3cb4-424f-81fa-34c313932fee tempest-VolumesTestJSON-767263321 None] Lock "cinder-c86adcb9-ca3a-45af-987d-c03a05490ea5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1db1ffb3-3cb4-424f-81fa-34c313932fee tempest-VolumesTestJSON-767263321 None] Acquiring lock "cinder-quobyte-c86adcb9-ca3a-45af-987d-c03a05490ea5" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1db1ffb3-3cb4-424f-81fa-34c313932fee tempest-VolumesTestJSON-767263321 None] Lock "cinder-quobyte-c86adcb9-ca3a-45af-987d-c03a05490ea5" acquired by "delete_volume" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:54 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5797027e-14d1-4ada-a163-e84c448562c3]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1db1ffb3-3cb4-424f-81fa-34c313932fee tempest-VolumesTestJSON-767263321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c86adcb9-ca3a-45af-987d-c03a05490ea5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:54 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c86adcb9-ca3a-45af-987d-c03a05490ea5 Sep 07 13:56:54 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:55 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1db1ffb3-3cb4-424f-81fa-34c313932fee tempest-VolumesTestJSON-767263321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c86adcb9-ca3a-45af-987d-c03a05490ea5" returned: 0 in 0.704s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1db1ffb3-3cb4-424f-81fa-34c313932fee tempest-VolumesTestJSON-767263321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c86adcb9-ca3a-45af-987d-c03a05490ea5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:55 devstack sudo[103624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c86adcb9-ca3a-45af-987d-c03a05490ea5 Sep 07 13:56:55 devstack sudo[103624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:56 devstack sudo[103624]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1db1ffb3-3cb4-424f-81fa-34c313932fee tempest-VolumesTestJSON-767263321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c86adcb9-ca3a-45af-987d-c03a05490ea5" returned: 0 in 0.674s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1db1ffb3-3cb4-424f-81fa-34c313932fee tempest-VolumesTestJSON-767263321 None] Lock "cinder-quobyte-c86adcb9-ca3a-45af-987d-c03a05490ea5" released by "delete_volume" :: held 1.483s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:56 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-1db1ffb3-3cb4-424f-81fa-34c313932fee tempest-VolumesTestJSON-767263321 None] Created reservations ['be8ff515-05ab-483b-b142-9e7f74802c98', '90173d9b-f448-4590-90ce-22799deb596f', '2df5900a-7aa3-4681-8d82-f032725895dc', 'dd03303c-9121-4bb0-8a8b-4442b7490a0c'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1db1ffb3-3cb4-424f-81fa-34c313932fee tempest-VolumesTestJSON-767263321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1db1ffb3-3cb4-424f-81fa-34c313932fee tempest-VolumesTestJSON-767263321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1db1ffb3-3cb4-424f-81fa-34c313932fee tempest-VolumesTestJSON-767263321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1db1ffb3-3cb4-424f-81fa-34c313932fee tempest-VolumesTestJSON-767263321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1db1ffb3-3cb4-424f-81fa-34c313932fee tempest-VolumesTestJSON-767263321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1db1ffb3-3cb4-424f-81fa-34c313932fee tempest-VolumesTestJSON-767263321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:56 devstack sudo[103637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:56:56 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5a88dab4-f005-43f7-86e4-a7fad2a98726 tempest-VolumesTestJSON-767263321 None] Acquiring lock "cinder-6bcea32b-be79-4b5f-af77-410ed53aeedf-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5a88dab4-f005-43f7-86e4-a7fad2a98726 tempest-VolumesTestJSON-767263321 None] Lock "cinder-6bcea32b-be79-4b5f-af77-410ed53aeedf-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:57 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1db1ffb3-3cb4-424f-81fa-34c313932fee tempest-VolumesTestJSON-767263321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.841s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:57 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-1db1ffb3-3cb4-424f-81fa-34c313932fee tempest-VolumesTestJSON-767263321 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:57 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-1db1ffb3-3cb4-424f-81fa-34c313932fee tempest-VolumesTestJSON-767263321 None] Deleted volume successfully. Sep 07 13:56:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5a88dab4-f005-43f7-86e4-a7fad2a98726 tempest-VolumesTestJSON-767263321 None] Acquiring lock "cinder-quobyte-6bcea32b-be79-4b5f-af77-410ed53aeedf" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1db1ffb3-3cb4-424f-81fa-34c313932fee tempest-VolumesTestJSON-767263321 None] Lock "cinder-c86adcb9-ca3a-45af-987d-c03a05490ea5-delete_volume" released by "delete_volume" :: held 2.921s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5a88dab4-f005-43f7-86e4-a7fad2a98726 tempest-VolumesTestJSON-767263321 None] Lock "cinder-quobyte-6bcea32b-be79-4b5f-af77-410ed53aeedf" acquired by "delete_volume" :: waited 0.058s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:57 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e707f9a-f804-41ac-adb8-fbc54ec48ca0]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5a88dab4-f005-43f7-86e4-a7fad2a98726 tempest-VolumesTestJSON-767263321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6bcea32b-be79-4b5f-af77-410ed53aeedf {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:58 devstack sudo[103641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6bcea32b-be79-4b5f-af77-410ed53aeedf Sep 07 13:56:58 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:58 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5a88dab4-f005-43f7-86e4-a7fad2a98726 tempest-VolumesTestJSON-767263321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6bcea32b-be79-4b5f-af77-410ed53aeedf" returned: 0 in 1.099s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5a88dab4-f005-43f7-86e4-a7fad2a98726 tempest-VolumesTestJSON-767263321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6bcea32b-be79-4b5f-af77-410ed53aeedf {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:58 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6bcea32b-be79-4b5f-af77-410ed53aeedf Sep 07 13:56:58 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:59 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5a88dab4-f005-43f7-86e4-a7fad2a98726 tempest-VolumesTestJSON-767263321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6bcea32b-be79-4b5f-af77-410ed53aeedf" returned: 0 in 0.846s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:59 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5a88dab4-f005-43f7-86e4-a7fad2a98726 tempest-VolumesTestJSON-767263321 None] Lock "cinder-quobyte-6bcea32b-be79-4b5f-af77-410ed53aeedf" released by "delete_volume" :: held 2.091s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:59 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-5a88dab4-f005-43f7-86e4-a7fad2a98726 tempest-VolumesTestJSON-767263321 None] Created reservations ['b78951bf-6ea1-4b4d-b429-9c742b5bb72a', '4e70fb8b-3c89-490a-9ab3-3359b47f3a14', '9dd9bc47-aaff-4b09-9721-bdcfb02e9e32', 'd1af4044-149d-4a53-83a6-acde3e229c77'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5a88dab4-f005-43f7-86e4-a7fad2a98726 tempest-VolumesTestJSON-767263321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5a88dab4-f005-43f7-86e4-a7fad2a98726 tempest-VolumesTestJSON-767263321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:59 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5a88dab4-f005-43f7-86e4-a7fad2a98726 tempest-VolumesTestJSON-767263321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:59 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5a88dab4-f005-43f7-86e4-a7fad2a98726 tempest-VolumesTestJSON-767263321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5a88dab4-f005-43f7-86e4-a7fad2a98726 tempest-VolumesTestJSON-767263321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5a88dab4-f005-43f7-86e4-a7fad2a98726 tempest-VolumesTestJSON-767263321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:59 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:56:59 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:00 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5a88dab4-f005-43f7-86e4-a7fad2a98726 tempest-VolumesTestJSON-767263321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.344s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:00 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-5a88dab4-f005-43f7-86e4-a7fad2a98726 tempest-VolumesTestJSON-767263321 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:57:00 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-5a88dab4-f005-43f7-86e4-a7fad2a98726 tempest-VolumesTestJSON-767263321 None] Deleted volume successfully. Sep 07 13:57:00 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5a88dab4-f005-43f7-86e4-a7fad2a98726 tempest-VolumesTestJSON-767263321 None] Lock "cinder-6bcea32b-be79-4b5f-af77-410ed53aeedf-delete_volume" released by "delete_volume" :: held 3.126s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:01 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-60a3b847-206f-4404-9638-f44a20c88a62" returned: 0 in 7.209s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:01 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb, size 1024.00 MB, duration 7.21 sec, destination /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-60a3b847-206f-4404-9638-f44a20c88a62 {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:57:01 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Converted 1024.00 MB image at 141.98 MB/s Sep 07 13:57:01 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-60a3b847-206f-4404-9638-f44a20c88a62 is being set with open permissions: ugo+rw Sep 07 13:57:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-60a3b847-206f-4404-9638-f44a20c88a62 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:01 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-60a3b847-206f-4404-9638-f44a20c88a62 Sep 07 13:57:01 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:01 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-60a3b847-206f-4404-9638-f44a20c88a62" returned: 0 in 0.477s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:01 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Lock "cinder-quobyte-60a3b847-206f-4404-9638-f44a20c88a62" released by "_copy_volume_from_snapshot" :: held 8.846s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Lock "cinder-quobyte-1c9f7c55-8a0c-400f-98f9-f7cdd3259d71-60a3b847-206f-4404-9638-f44a20c88a62" released by "_create_volume_from_snapshot" :: held 8.986s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ff90ce-a299-4ae6-a122-25b5b02abe2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60a3b847-206f-4404-9638-f44a20c88a62', 'volume_size': 1, 'snapshot_id': '1c9f7c55-8a0c-400f-98f9-f7cdd3259d71'}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (545af1dc-981f-4567-908a-66d009520875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:02 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Volume volume-60a3b847-206f-4404-9638-f44a20c88a62 (60a3b847-206f-4404-9638-f44a20c88a62): created successfully Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (545af1dc-981f-4567-908a-66d009520875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Flow 'volume_create_manager' (cabe8c4f-4a48-4446-a21c-0de488ee9024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:02 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-117c9252-2209-4cc1-8ac4-22a19af6ec10 tempest-TestStampPattern-1657532424 None] Created volume successfully. Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Flow 'volume_create_manager' (732f5182-3ab5-40bf-a196-89784b021128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10cde23c-448c-4c3b-9aa0-3ae49491d42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10cde23c-448c-4c3b-9aa0-3ae49491d42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-719920454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c91b44c-1e10-43c0-8bc7-fd8009001bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48eed38e08c14fa78badfdf10c344ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:02Z,use_quota=True,user_id='3965fb11f488487ca9fd66c614b43206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d7a4357-8c94-4911-b793-0408f6a2f68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d7a4357-8c94-4911-b793-0408f6a2f68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce487b7a-96f5-4f1f-ad2b-275657c21576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce487b7a-96f5-4f1f-ad2b-275657c21576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c91b44c-1e10-43c0-8bc7-fd8009001bda', 'volume_name': 'volume-9c91b44c-1e10-43c0-8bc7-fd8009001bda', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e16b02c-2520-438b-bf1a-7f9a412b4106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e16b02c-2520-438b-bf1a-7f9a412b4106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98edeff-3bb3-4b34-9cba-0b38f873915b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:02 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Volume 9c91b44c-1e10-43c0-8bc7-fd8009001bda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c91b44c-1e10-43c0-8bc7-fd8009001bda', 'volume_size': 1} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-719920454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c91b44c-1e10-43c0-8bc7-fd8009001bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48eed38e08c14fa78badfdf10c344ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:02Z,use_quota=True,user_id='3965fb11f488487ca9fd66c614b43206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Creating volume 9c91b44c-1e10-43c0-8bc7-fd8009001bda {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:57:02 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:57:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c91b44c-1e10-43c0-8bc7-fd8009001bda 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:02 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c91b44c-1e10-43c0-8bc7-fd8009001bda 1073741824 Sep 07 13:57:02 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:03 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c91b44c-1e10-43c0-8bc7-fd8009001bda 1073741824" returned: 0 in 0.599s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c91b44c-1e10-43c0-8bc7-fd8009001bda {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:03 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c91b44c-1e10-43c0-8bc7-fd8009001bda Sep 07 13:57:03 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:03 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c91b44c-1e10-43c0-8bc7-fd8009001bda" returned: 0 in 0.456s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:03 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:57:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98edeff-3bb3-4b34-9cba-0b38f873915b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c91b44c-1e10-43c0-8bc7-fd8009001bda', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3ddd8f-bd58-4447-9edf-2e71fc4b4f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:03 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Volume volume-9c91b44c-1e10-43c0-8bc7-fd8009001bda (9c91b44c-1e10-43c0-8bc7-fd8009001bda): created successfully Sep 07 13:57:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3ddd8f-bd58-4447-9edf-2e71fc4b4f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Flow 'volume_create_manager' (732f5182-3ab5-40bf-a196-89784b021128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:03 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-28465bda-8c32-4a4c-8c43-4c026936d47d tempest-ProjectReaderTests-204920926 None] Created volume successfully. Sep 07 13:57:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-46f1cd18-cfb4-49e7-bd6f-959872e374a7 tempest-ProjectReaderTests-204920926 None] Acquiring lock "cinder-9c91b44c-1e10-43c0-8bc7-fd8009001bda-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-46f1cd18-cfb4-49e7-bd6f-959872e374a7 tempest-ProjectReaderTests-204920926 None] Lock "cinder-9c91b44c-1e10-43c0-8bc7-fd8009001bda-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-46f1cd18-cfb4-49e7-bd6f-959872e374a7 tempest-ProjectReaderTests-204920926 None] Acquiring lock "cinder-quobyte-9c91b44c-1e10-43c0-8bc7-fd8009001bda" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-46f1cd18-cfb4-49e7-bd6f-959872e374a7 tempest-ProjectReaderTests-204920926 None] Lock "cinder-quobyte-9c91b44c-1e10-43c0-8bc7-fd8009001bda" acquired by "delete_volume" :: waited 0.014s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:05 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4460c712-2384-42db-951b-74946e3589f7]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:57:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-46f1cd18-cfb4-49e7-bd6f-959872e374a7 tempest-ProjectReaderTests-204920926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c91b44c-1e10-43c0-8bc7-fd8009001bda {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:05 devstack sudo[103730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c91b44c-1e10-43c0-8bc7-fd8009001bda Sep 07 13:57:05 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:05 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-46f1cd18-cfb4-49e7-bd6f-959872e374a7 tempest-ProjectReaderTests-204920926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c91b44c-1e10-43c0-8bc7-fd8009001bda" returned: 0 in 0.475s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-46f1cd18-cfb4-49e7-bd6f-959872e374a7 tempest-ProjectReaderTests-204920926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c91b44c-1e10-43c0-8bc7-fd8009001bda {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:05 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c91b44c-1e10-43c0-8bc7-fd8009001bda Sep 07 13:57:05 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:05 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-46f1cd18-cfb4-49e7-bd6f-959872e374a7 tempest-ProjectReaderTests-204920926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c91b44c-1e10-43c0-8bc7-fd8009001bda" returned: 0 in 0.312s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-46f1cd18-cfb4-49e7-bd6f-959872e374a7 tempest-ProjectReaderTests-204920926 None] Lock "cinder-quobyte-9c91b44c-1e10-43c0-8bc7-fd8009001bda" released by "delete_volume" :: held 0.840s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:06 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-46f1cd18-cfb4-49e7-bd6f-959872e374a7 tempest-ProjectReaderTests-204920926 None] Created reservations ['30215d0a-4cb4-44e1-b173-56320d17717b', 'cbc4f180-fbe3-4ec6-983c-024d5890f7c7', '98e577a3-257d-4166-98a1-95789044d04e', 'ff81a01c-aeff-4d32-afe3-064dccdf425e'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:57:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-46f1cd18-cfb4-49e7-bd6f-959872e374a7 tempest-ProjectReaderTests-204920926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-46f1cd18-cfb4-49e7-bd6f-959872e374a7 tempest-ProjectReaderTests-204920926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-46f1cd18-cfb4-49e7-bd6f-959872e374a7 tempest-ProjectReaderTests-204920926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-46f1cd18-cfb4-49e7-bd6f-959872e374a7 tempest-ProjectReaderTests-204920926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-46f1cd18-cfb4-49e7-bd6f-959872e374a7 tempest-ProjectReaderTests-204920926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-46f1cd18-cfb4-49e7-bd6f-959872e374a7 tempest-ProjectReaderTests-204920926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:06 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:57:06 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:06 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-46f1cd18-cfb4-49e7-bd6f-959872e374a7 tempest-ProjectReaderTests-204920926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.435s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:06 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-46f1cd18-cfb4-49e7-bd6f-959872e374a7 tempest-ProjectReaderTests-204920926 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:57:06 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-46f1cd18-cfb4-49e7-bd6f-959872e374a7 tempest-ProjectReaderTests-204920926 None] Deleted volume successfully. Sep 07 13:57:06 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-46f1cd18-cfb4-49e7-bd6f-959872e374a7 tempest-ProjectReaderTests-204920926 None] Lock "cinder-9c91b44c-1e10-43c0-8bc7-fd8009001bda-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:07 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:57:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Flow 'volume_create_manager' (5777135f-fd60-403f-a8c0-d071a891092d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d88cee-cb28-40c7-9bde-757c663914e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d88cee-cb28-40c7-9bde-757c663914e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1176455650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f799f88e-f775-4029-a2ad-fa6cb1542b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48eed38e08c14fa78badfdf10c344ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:07Z,use_quota=True,user_id='3965fb11f488487ca9fd66c614b43206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6157c3e2-ccce-4920-aac2-2891c83453ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6157c3e2-ccce-4920-aac2-2891c83453ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6017d69-9f3b-48e2-8dff-94dcee59855f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6017d69-9f3b-48e2-8dff-94dcee59855f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f799f88e-f775-4029-a2ad-fa6cb1542b6a', 'volume_name': 'volume-f799f88e-f775-4029-a2ad-fa6cb1542b6a', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831966e4-6848-4ca7-8ee6-05ffd19b3335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831966e4-6848-4ca7-8ee6-05ffd19b3335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fccdbba8-d296-4393-a797-22c00df10591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:07 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Volume f799f88e-f775-4029-a2ad-fa6cb1542b6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f799f88e-f775-4029-a2ad-fa6cb1542b6a', 'volume_size': 1} Sep 07 13:57:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1176455650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f799f88e-f775-4029-a2ad-fa6cb1542b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48eed38e08c14fa78badfdf10c344ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:07Z,use_quota=True,user_id='3965fb11f488487ca9fd66c614b43206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:57:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Creating volume f799f88e-f775-4029-a2ad-fa6cb1542b6a {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:57:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:57:07 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:57:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f799f88e-f775-4029-a2ad-fa6cb1542b6a 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:07 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f799f88e-f775-4029-a2ad-fa6cb1542b6a 1073741824 Sep 07 13:57:07 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:08 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f799f88e-f775-4029-a2ad-fa6cb1542b6a 1073741824" returned: 0 in 0.761s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f799f88e-f775-4029-a2ad-fa6cb1542b6a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:08 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f799f88e-f775-4029-a2ad-fa6cb1542b6a Sep 07 13:57:08 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:08 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f799f88e-f775-4029-a2ad-fa6cb1542b6a" returned: 0 in 0.382s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:08 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:57:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fccdbba8-d296-4393-a797-22c00df10591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f799f88e-f775-4029-a2ad-fa6cb1542b6a', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (351fe084-a6cf-437f-a7f0-d3ae94540c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:08 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Volume volume-f799f88e-f775-4029-a2ad-fa6cb1542b6a (f799f88e-f775-4029-a2ad-fa6cb1542b6a): created successfully Sep 07 13:57:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (351fe084-a6cf-437f-a7f0-d3ae94540c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Flow 'volume_create_manager' (5777135f-fd60-403f-a8c0-d071a891092d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:08 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-37eb14eb-3c34-4b9c-a810-a01ac97370fb tempest-ProjectReaderTests-204920926 None] Created volume successfully. Sep 07 13:57:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4786ce53-1159-4f8c-afa3-668ff5c6fdaa tempest-ProjectReaderTests-204920926 None] Acquiring lock "cinder-f799f88e-f775-4029-a2ad-fa6cb1542b6a-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4786ce53-1159-4f8c-afa3-668ff5c6fdaa tempest-ProjectReaderTests-204920926 None] Lock "cinder-f799f88e-f775-4029-a2ad-fa6cb1542b6a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4786ce53-1159-4f8c-afa3-668ff5c6fdaa tempest-ProjectReaderTests-204920926 None] Acquiring lock "cinder-quobyte-f799f88e-f775-4029-a2ad-fa6cb1542b6a" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4786ce53-1159-4f8c-afa3-668ff5c6fdaa tempest-ProjectReaderTests-204920926 None] Lock "cinder-quobyte-f799f88e-f775-4029-a2ad-fa6cb1542b6a" acquired by "delete_volume" :: waited 0.031s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:09 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd86af4a-5558-45bc-a947-c7665acb6227]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:57:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4786ce53-1159-4f8c-afa3-668ff5c6fdaa tempest-ProjectReaderTests-204920926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f799f88e-f775-4029-a2ad-fa6cb1542b6a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:09 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f799f88e-f775-4029-a2ad-fa6cb1542b6a Sep 07 13:57:09 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:10 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4786ce53-1159-4f8c-afa3-668ff5c6fdaa tempest-ProjectReaderTests-204920926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f799f88e-f775-4029-a2ad-fa6cb1542b6a" returned: 0 in 0.521s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4786ce53-1159-4f8c-afa3-668ff5c6fdaa tempest-ProjectReaderTests-204920926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f799f88e-f775-4029-a2ad-fa6cb1542b6a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:10 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f799f88e-f775-4029-a2ad-fa6cb1542b6a Sep 07 13:57:10 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:10 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4786ce53-1159-4f8c-afa3-668ff5c6fdaa tempest-ProjectReaderTests-204920926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f799f88e-f775-4029-a2ad-fa6cb1542b6a" returned: 0 in 0.346s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4786ce53-1159-4f8c-afa3-668ff5c6fdaa tempest-ProjectReaderTests-204920926 None] Lock "cinder-quobyte-f799f88e-f775-4029-a2ad-fa6cb1542b6a" released by "delete_volume" :: held 0.923s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:10 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-4786ce53-1159-4f8c-afa3-668ff5c6fdaa tempest-ProjectReaderTests-204920926 None] Created reservations ['aa6b5ed4-4772-4dc8-987a-67631d54ec05', '1a95dba8-a19e-4a64-8839-49891f9984af', '6f9d2b8c-e41f-462b-89f5-cbee54d88d7d', 'ed1b44da-c8da-489f-b1da-641ca812d42e'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:57:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4786ce53-1159-4f8c-afa3-668ff5c6fdaa tempest-ProjectReaderTests-204920926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4786ce53-1159-4f8c-afa3-668ff5c6fdaa tempest-ProjectReaderTests-204920926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4786ce53-1159-4f8c-afa3-668ff5c6fdaa tempest-ProjectReaderTests-204920926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4786ce53-1159-4f8c-afa3-668ff5c6fdaa tempest-ProjectReaderTests-204920926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4786ce53-1159-4f8c-afa3-668ff5c6fdaa tempest-ProjectReaderTests-204920926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4786ce53-1159-4f8c-afa3-668ff5c6fdaa tempest-ProjectReaderTests-204920926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:10 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:57:10 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:10 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4786ce53-1159-4f8c-afa3-668ff5c6fdaa tempest-ProjectReaderTests-204920926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.275s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:10 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-4786ce53-1159-4f8c-afa3-668ff5c6fdaa tempest-ProjectReaderTests-204920926 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:57:10 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-4786ce53-1159-4f8c-afa3-668ff5c6fdaa tempest-ProjectReaderTests-204920926 None] Deleted volume successfully. Sep 07 13:57:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4786ce53-1159-4f8c-afa3-668ff5c6fdaa tempest-ProjectReaderTests-204920926 None] Lock "cinder-f799f88e-f775-4029-a2ad-fa6cb1542b6a-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Flow 'volume_create_manager' (3a88e2d0-1979-4f15-a64b-3d475dc4978e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (becb14ee-4bee-4952-9c47-8ffda06344df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (becb14ee-4bee-4952-9c47-8ffda06344df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-300454639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a06fb2e-a59f-41a4-837d-99ecb3201afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99eb4bcca2b14248b7f9a2317a244a55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:20Z,use_quota=True,user_id='701fd4e8b7024a65a8c3250076e470d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0be812c-a9b4-433a-be36-83edac0dead8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0be812c-a9b4-433a-be36-83edac0dead8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8489e53-9ab4-495a-a4b6-d7583063a5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8489e53-9ab4-495a-a4b6-d7583063a5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a06fb2e-a59f-41a4-837d-99ecb3201afe', 'volume_name': 'volume-7a06fb2e-a59f-41a4-837d-99ecb3201afe', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2f56e9-2a37-4c48-98d7-d815c6948204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2f56e9-2a37-4c48-98d7-d815c6948204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79179a1-fd4d-4b42-9f80-da99a49f8eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:20 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Volume 7a06fb2e-a59f-41a4-837d-99ecb3201afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a06fb2e-a59f-41a4-837d-99ecb3201afe', 'volume_size': 1} Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-300454639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a06fb2e-a59f-41a4-837d-99ecb3201afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99eb4bcca2b14248b7f9a2317a244a55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:20Z,use_quota=True,user_id='701fd4e8b7024a65a8c3250076e470d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Creating volume 7a06fb2e-a59f-41a4-837d-99ecb3201afe {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:57:20 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a06fb2e-a59f-41a4-837d-99ecb3201afe 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:20 devstack sudo[103818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a06fb2e-a59f-41a4-837d-99ecb3201afe 1073741824 Sep 07 13:57:20 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:20 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a06fb2e-a59f-41a4-837d-99ecb3201afe 1073741824" returned: 0 in 0.395s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a06fb2e-a59f-41a4-837d-99ecb3201afe {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:21 devstack sudo[103829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a06fb2e-a59f-41a4-837d-99ecb3201afe Sep 07 13:57:21 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:21 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a06fb2e-a59f-41a4-837d-99ecb3201afe" returned: 0 in 0.249s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:57:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79179a1-fd4d-4b42-9f80-da99a49f8eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a06fb2e-a59f-41a4-837d-99ecb3201afe', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c0e1fde-1c5c-454f-81f2-dce24a258ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:21 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Volume volume-7a06fb2e-a59f-41a4-837d-99ecb3201afe (7a06fb2e-a59f-41a4-837d-99ecb3201afe): created successfully Sep 07 13:57:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c0e1fde-1c5c-454f-81f2-dce24a258ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Flow 'volume_create_manager' (3a88e2d0-1979-4f15-a64b-3d475dc4978e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:21 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-b962600d-c93d-4f1d-8d6b-aad21b5d3d5e tempest-VolumeQuotasAdminTestJSON-1694400945 None] Created volume successfully. Sep 07 13:57:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-822ba7fc-bf9a-48da-a970-ddf34263fe45 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Acquiring lock "cinder-7a06fb2e-a59f-41a4-837d-99ecb3201afe-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-822ba7fc-bf9a-48da-a970-ddf34263fe45 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Lock "cinder-7a06fb2e-a59f-41a4-837d-99ecb3201afe-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-822ba7fc-bf9a-48da-a970-ddf34263fe45 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Acquiring lock "cinder-quobyte-7a06fb2e-a59f-41a4-837d-99ecb3201afe" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-822ba7fc-bf9a-48da-a970-ddf34263fe45 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Lock "cinder-quobyte-7a06fb2e-a59f-41a4-837d-99ecb3201afe" acquired by "delete_volume" :: waited 0.016s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:21 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6332f24f-2811-4b44-b317-745dafa39939]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:57:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-822ba7fc-bf9a-48da-a970-ddf34263fe45 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a06fb2e-a59f-41a4-837d-99ecb3201afe {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:21 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a06fb2e-a59f-41a4-837d-99ecb3201afe Sep 07 13:57:21 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:21 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-822ba7fc-bf9a-48da-a970-ddf34263fe45 tempest-VolumeQuotasAdminTestJSON-1694400945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a06fb2e-a59f-41a4-837d-99ecb3201afe" returned: 0 in 0.346s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-822ba7fc-bf9a-48da-a970-ddf34263fe45 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a06fb2e-a59f-41a4-837d-99ecb3201afe {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:21 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a06fb2e-a59f-41a4-837d-99ecb3201afe Sep 07 13:57:21 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:22 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-822ba7fc-bf9a-48da-a970-ddf34263fe45 tempest-VolumeQuotasAdminTestJSON-1694400945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a06fb2e-a59f-41a4-837d-99ecb3201afe" returned: 0 in 0.234s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:22 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-822ba7fc-bf9a-48da-a970-ddf34263fe45 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Lock "cinder-quobyte-7a06fb2e-a59f-41a4-837d-99ecb3201afe" released by "delete_volume" :: held 0.614s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:22 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-822ba7fc-bf9a-48da-a970-ddf34263fe45 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Created reservations ['1df5fea7-8950-4475-a3f7-919189ce442e', 'b267be11-cad4-4c6d-a840-fdd67e9cc3dd', '4cd68be7-20d3-4423-a7ee-ef4db000198f', '6dd92f04-fdbb-4869-be0a-15dc67d1dea5'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:57:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-822ba7fc-bf9a-48da-a970-ddf34263fe45 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-822ba7fc-bf9a-48da-a970-ddf34263fe45 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-822ba7fc-bf9a-48da-a970-ddf34263fe45 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-822ba7fc-bf9a-48da-a970-ddf34263fe45 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-822ba7fc-bf9a-48da-a970-ddf34263fe45 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-822ba7fc-bf9a-48da-a970-ddf34263fe45 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:22 devstack sudo[103840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:57:22 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:22 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-822ba7fc-bf9a-48da-a970-ddf34263fe45 tempest-VolumeQuotasAdminTestJSON-1694400945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.225s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:22 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-822ba7fc-bf9a-48da-a970-ddf34263fe45 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:57:22 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-822ba7fc-bf9a-48da-a970-ddf34263fe45 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Deleted volume successfully. Sep 07 13:57:22 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-822ba7fc-bf9a-48da-a970-ddf34263fe45 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Lock "cinder-7a06fb2e-a59f-41a4-837d-99ecb3201afe-delete_volume" released by "delete_volume" :: held 1.031s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Flow 'volume_create_manager' (14c406b2-699d-4971-b48f-f3323dfc1031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c98ae2e-f368-475c-931e-12e9c4bd0456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c98ae2e-f368-475c-931e-12e9c4bd0456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1345141890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33265cb7-f7b1-4407-8f6f-9756eaa391cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99eb4bcca2b14248b7f9a2317a244a55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:23Z,use_quota=True,user_id='701fd4e8b7024a65a8c3250076e470d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e6ff10-43ca-484d-aedb-90e86c8733ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e6ff10-43ca-484d-aedb-90e86c8733ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73917753-107f-4979-982f-ba7f9bc47718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73917753-107f-4979-982f-ba7f9bc47718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33265cb7-f7b1-4407-8f6f-9756eaa391cd', 'volume_name': 'volume-33265cb7-f7b1-4407-8f6f-9756eaa391cd', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70bc32e1-8008-4960-9fdb-b6272d890f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70bc32e1-8008-4960-9fdb-b6272d890f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091145df-e5fa-453f-8ac1-059f2ff7be08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:23 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Volume 33265cb7-f7b1-4407-8f6f-9756eaa391cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33265cb7-f7b1-4407-8f6f-9756eaa391cd', 'volume_size': 1} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1345141890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33265cb7-f7b1-4407-8f6f-9756eaa391cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99eb4bcca2b14248b7f9a2317a244a55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:23Z,use_quota=True,user_id='701fd4e8b7024a65a8c3250076e470d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Creating volume 33265cb7-f7b1-4407-8f6f-9756eaa391cd {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:57:23 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33265cb7-f7b1-4407-8f6f-9756eaa391cd 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:23 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33265cb7-f7b1-4407-8f6f-9756eaa391cd 1073741824 Sep 07 13:57:23 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:23 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33265cb7-f7b1-4407-8f6f-9756eaa391cd 1073741824" returned: 0 in 0.381s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33265cb7-f7b1-4407-8f6f-9756eaa391cd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:23 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33265cb7-f7b1-4407-8f6f-9756eaa391cd Sep 07 13:57:23 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:23 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33265cb7-f7b1-4407-8f6f-9756eaa391cd" returned: 0 in 0.232s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] <== create_volume: return (653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.655s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091145df-e5fa-453f-8ac1-059f2ff7be08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33265cb7-f7b1-4407-8f6f-9756eaa391cd', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e35a918-263a-42d6-ab51-47e57be85a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:23 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Volume volume-33265cb7-f7b1-4407-8f6f-9756eaa391cd (33265cb7-f7b1-4407-8f6f-9756eaa391cd): created successfully Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e35a918-263a-42d6-ab51-47e57be85a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Flow 'volume_create_manager' (14c406b2-699d-4971-b48f-f3323dfc1031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:23 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-9529fd29-5df4-48db-a09e-d25bcbc50b91 tempest-VolumeQuotasAdminTestJSON-1694400945 None] Created volume successfully. Sep 07 13:57:24 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-f2143909-94e5-4463-aaaf-9b822a9e0e6a tempest-VolumeQuotasAdminTestJSON-996951234 None] Transfer volume completed successfully. Sep 07 13:57:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d2919e73-869e-4476-a145-df4c40525703 tempest-VolumeQuotasAdminTestJSON-26466022 None] Acquiring lock "cinder-33265cb7-f7b1-4407-8f6f-9756eaa391cd-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d2919e73-869e-4476-a145-df4c40525703 tempest-VolumeQuotasAdminTestJSON-26466022 None] Lock "cinder-33265cb7-f7b1-4407-8f6f-9756eaa391cd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d2919e73-869e-4476-a145-df4c40525703 tempest-VolumeQuotasAdminTestJSON-26466022 None] Acquiring lock "cinder-quobyte-33265cb7-f7b1-4407-8f6f-9756eaa391cd" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d2919e73-869e-4476-a145-df4c40525703 tempest-VolumeQuotasAdminTestJSON-26466022 None] Lock "cinder-quobyte-33265cb7-f7b1-4407-8f6f-9756eaa391cd" acquired by "delete_volume" :: waited 0.013s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:25 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[32435cab-b083-4e13-8b8c-4996115adb2a]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:57:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d2919e73-869e-4476-a145-df4c40525703 tempest-VolumeQuotasAdminTestJSON-26466022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33265cb7-f7b1-4407-8f6f-9756eaa391cd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:25 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33265cb7-f7b1-4407-8f6f-9756eaa391cd Sep 07 13:57:25 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:25 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d2919e73-869e-4476-a145-df4c40525703 tempest-VolumeQuotasAdminTestJSON-26466022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33265cb7-f7b1-4407-8f6f-9756eaa391cd" returned: 0 in 0.355s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d2919e73-869e-4476-a145-df4c40525703 tempest-VolumeQuotasAdminTestJSON-26466022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33265cb7-f7b1-4407-8f6f-9756eaa391cd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:25 devstack sudo[103856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33265cb7-f7b1-4407-8f6f-9756eaa391cd Sep 07 13:57:25 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:25 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d2919e73-869e-4476-a145-df4c40525703 tempest-VolumeQuotasAdminTestJSON-26466022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33265cb7-f7b1-4407-8f6f-9756eaa391cd" returned: 0 in 0.228s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d2919e73-869e-4476-a145-df4c40525703 tempest-VolumeQuotasAdminTestJSON-26466022 None] Lock "cinder-quobyte-33265cb7-f7b1-4407-8f6f-9756eaa391cd" released by "delete_volume" :: held 0.619s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:25 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-d2919e73-869e-4476-a145-df4c40525703 tempest-VolumeQuotasAdminTestJSON-26466022 None] Created reservations ['0422f676-899a-4678-9d8e-d1ab9ad958ad', 'a4269951-9f12-44b7-8289-15a3eadaa30a', 'e555fe0f-03db-421e-ae0c-31a3c233fc2e', 'ad075cb8-ad08-4daf-8349-22f15f7909d9'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:57:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d2919e73-869e-4476-a145-df4c40525703 tempest-VolumeQuotasAdminTestJSON-26466022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d2919e73-869e-4476-a145-df4c40525703 tempest-VolumeQuotasAdminTestJSON-26466022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d2919e73-869e-4476-a145-df4c40525703 tempest-VolumeQuotasAdminTestJSON-26466022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d2919e73-869e-4476-a145-df4c40525703 tempest-VolumeQuotasAdminTestJSON-26466022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d2919e73-869e-4476-a145-df4c40525703 tempest-VolumeQuotasAdminTestJSON-26466022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d2919e73-869e-4476-a145-df4c40525703 tempest-VolumeQuotasAdminTestJSON-26466022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:26 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:57:26 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:26 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d2919e73-869e-4476-a145-df4c40525703 tempest-VolumeQuotasAdminTestJSON-26466022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.225s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:26 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-d2919e73-869e-4476-a145-df4c40525703 tempest-VolumeQuotasAdminTestJSON-26466022 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:57:26 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-d2919e73-869e-4476-a145-df4c40525703 tempest-VolumeQuotasAdminTestJSON-26466022 None] Deleted volume successfully. Sep 07 13:57:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d2919e73-869e-4476-a145-df4c40525703 tempest-VolumeQuotasAdminTestJSON-26466022 None] Lock "cinder-33265cb7-f7b1-4407-8f6f-9756eaa391cd-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:57:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:28 devstack sudo[103863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:57:28 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:28 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.254s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:57:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager._thread_info {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:57:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread count: 28 {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:57:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread info: [<_MainThread(MainThread, started 132147689414784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Flow 'volume_create_manager' (a6e34413-46e4-4e5d-820d-edbf1e9ef5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375240be-f414-4020-b08e-2e46de85d344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375240be-f414-4020-b08e-2e46de85d344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1861938014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e39105-ecb4-44e6-abad-32dc13b3bf06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8d65a422a584324824ba481ec5e38bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:33Z,use_quota=True,user_id='41937bcc081141ad9754daf54f02b262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc0db3e-33c6-4b14-953f-6e790ca84784),volume_type_id=edc0db3e-33c6-4b14-953f-6e790ca84784)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de797bf5-f61e-4e13-84cc-512c6757a2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de797bf5-f61e-4e13-84cc-512c6757a2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916a1527-5875-49ef-8861-2a62cc0b6495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916a1527-5875-49ef-8861-2a62cc0b6495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64e39105-ecb4-44e6-abad-32dc13b3bf06', 'volume_name': 'volume-64e39105-ecb4-44e6-abad-32dc13b3bf06', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3551c12c-e322-4958-8d9a-68edabebe6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3551c12c-e322-4958-8d9a-68edabebe6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f088cf7-fb91-4002-a148-1d78b59a53a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:33 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Volume 64e39105-ecb4-44e6-abad-32dc13b3bf06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64e39105-ecb4-44e6-abad-32dc13b3bf06', 'volume_size': 1} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1861938014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e39105-ecb4-44e6-abad-32dc13b3bf06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8d65a422a584324824ba481ec5e38bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:33Z,use_quota=True,user_id='41937bcc081141ad9754daf54f02b262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc0db3e-33c6-4b14-953f-6e790ca84784),volume_type_id=edc0db3e-33c6-4b14-953f-6e790ca84784)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Creating volume 64e39105-ecb4-44e6-abad-32dc13b3bf06 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:57:33 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-64e39105-ecb4-44e6-abad-32dc13b3bf06 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:33 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-64e39105-ecb4-44e6-abad-32dc13b3bf06 1073741824 Sep 07 13:57:33 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:33 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-64e39105-ecb4-44e6-abad-32dc13b3bf06 1073741824" returned: 0 in 0.376s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-64e39105-ecb4-44e6-abad-32dc13b3bf06 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:33 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-64e39105-ecb4-44e6-abad-32dc13b3bf06 Sep 07 13:57:33 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:33 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-64e39105-ecb4-44e6-abad-32dc13b3bf06" returned: 0 in 0.236s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] <== create_volume: return (657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.659s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f088cf7-fb91-4002-a148-1d78b59a53a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64e39105-ecb4-44e6-abad-32dc13b3bf06', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baea447c-8b1a-4288-a3be-055aad45d4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:33 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Volume volume-64e39105-ecb4-44e6-abad-32dc13b3bf06 (64e39105-ecb4-44e6-abad-32dc13b3bf06): created successfully Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baea447c-8b1a-4288-a3be-055aad45d4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Flow 'volume_create_manager' (a6e34413-46e4-4e5d-820d-edbf1e9ef5ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:33 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c8d228f3-5f83-48e8-ad78-e88cd372b941 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Created volume successfully. Sep 07 13:57:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-afbe4b45-1dab-42d8-a3de-8ba28291f53f tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-afbe4b45-1dab-42d8-a3de-8ba28291f53f tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-afbe4b45-1dab-42d8-a3de-8ba28291f53f tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-afbe4b45-1dab-42d8-a3de-8ba28291f53f tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-afbe4b45-1dab-42d8-a3de-8ba28291f53f tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-afbe4b45-1dab-42d8-a3de-8ba28291f53f tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:34 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:57:34 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:34 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-afbe4b45-1dab-42d8-a3de-8ba28291f53f tempest-VolumeRetypeWithoutMigrationTest-730003788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.235s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:34 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-afbe4b45-1dab-42d8-a3de-8ba28291f53f tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:57:34 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-afbe4b45-1dab-42d8-a3de-8ba28291f53f tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Retype volume completed successfully. Sep 07 13:57:35 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-34d2b9ae-50a2-4256-a605-45be89653135 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Acquiring lock "cinder-64e39105-ecb4-44e6-abad-32dc13b3bf06-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:35 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-34d2b9ae-50a2-4256-a605-45be89653135 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Lock "cinder-64e39105-ecb4-44e6-abad-32dc13b3bf06-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:35 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-34d2b9ae-50a2-4256-a605-45be89653135 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Acquiring lock "cinder-quobyte-64e39105-ecb4-44e6-abad-32dc13b3bf06" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:35 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-34d2b9ae-50a2-4256-a605-45be89653135 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Lock "cinder-quobyte-64e39105-ecb4-44e6-abad-32dc13b3bf06" acquired by "delete_volume" :: waited 0.015s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:35 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd25f91e-e034-4db6-9450-c37e6a9cd302]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:57:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-34d2b9ae-50a2-4256-a605-45be89653135 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-64e39105-ecb4-44e6-abad-32dc13b3bf06 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:35 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-64e39105-ecb4-44e6-abad-32dc13b3bf06 Sep 07 13:57:35 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:36 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-34d2b9ae-50a2-4256-a605-45be89653135 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-64e39105-ecb4-44e6-abad-32dc13b3bf06" returned: 0 in 0.361s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-34d2b9ae-50a2-4256-a605-45be89653135 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-64e39105-ecb4-44e6-abad-32dc13b3bf06 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:36 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-64e39105-ecb4-44e6-abad-32dc13b3bf06 Sep 07 13:57:36 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:36 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-34d2b9ae-50a2-4256-a605-45be89653135 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-64e39105-ecb4-44e6-abad-32dc13b3bf06" returned: 0 in 0.236s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:36 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-34d2b9ae-50a2-4256-a605-45be89653135 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Lock "cinder-quobyte-64e39105-ecb4-44e6-abad-32dc13b3bf06" released by "delete_volume" :: held 0.635s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:36 devstack cinder-volume[87571]: WARNING cinder.quota [None req-34d2b9ae-50a2-4256-a605-45be89653135 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:57:36 devstack cinder-volume[87571]: WARNING cinder.quota [None req-34d2b9ae-50a2-4256-a605-45be89653135 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:57:36 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-34d2b9ae-50a2-4256-a605-45be89653135 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Created reservations ['0725dbf4-f218-40a3-8580-ff03f70d58ca', '165b42a3-1218-4a98-b59b-06488aa3c45c', '7bfe013a-30de-4381-9588-85b0d5eeddc7', '995e8133-d3db-4f96-befa-b3c5a7a0ea06'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:57:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-34d2b9ae-50a2-4256-a605-45be89653135 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-34d2b9ae-50a2-4256-a605-45be89653135 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-34d2b9ae-50a2-4256-a605-45be89653135 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-34d2b9ae-50a2-4256-a605-45be89653135 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-34d2b9ae-50a2-4256-a605-45be89653135 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-34d2b9ae-50a2-4256-a605-45be89653135 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:36 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:57:36 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:36 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-34d2b9ae-50a2-4256-a605-45be89653135 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.243s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:36 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-34d2b9ae-50a2-4256-a605-45be89653135 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:57:36 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-34d2b9ae-50a2-4256-a605-45be89653135 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Deleted volume successfully. Sep 07 13:57:36 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-34d2b9ae-50a2-4256-a605-45be89653135 tempest-VolumeRetypeWithoutMigrationTest-730003788 None] Lock "cinder-64e39105-ecb4-44e6-abad-32dc13b3bf06-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:46 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=88,cinder:UPDATE=114,cinder:INSERT=28,cinder:DELETE=12 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:57:46 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=89,cinder:INSERT=26,cinder:DELETE=8,cinder:UPDATE=120 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:57:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-fb6ab08e-2ddf-465c-9af0-f06176593b51 req-e1b0b419-34a2-427e-b4a1-9627f3cf5b9d tempest-TestStampPattern-1657532424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-fb6ab08e-2ddf-465c-9af0-f06176593b51 req-e1b0b419-34a2-427e-b4a1-9627f3cf5b9d tempest-TestStampPattern-1657532424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-fb6ab08e-2ddf-465c-9af0-f06176593b51 req-e1b0b419-34a2-427e-b4a1-9627f3cf5b9d tempest-TestStampPattern-1657532424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:46 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-fb6ab08e-2ddf-465c-9af0-f06176593b51 req-e1b0b419-34a2-427e-b4a1-9627f3cf5b9d tempest-TestStampPattern-1657532424 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285', 'name': 'volume-60a3b847-206f-4404-9638-f44a20c88a62', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12f57b67-f583-4e6d-859a-2e0e3a05880e', 'enforce_multipath': True} {{(pid=87571) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:57:46 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-fb6ab08e-2ddf-465c-9af0-f06176593b51 req-e1b0b419-34a2-427e-b4a1-9627f3cf5b9d tempest-TestStampPattern-1657532424 None] attachment_update completed successfully. Sep 07 13:57:49 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-53ef735c-ff13-4558-aba1-d7ca0fdb4c9a req-df4d7bc0-cd4a-439c-8e57-1435eba5b6c8 tempest-TestStampPattern-1657532424 None] Terminate volume connection completed successfully. Sep 07 13:57:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-53ef735c-ff13-4558-aba1-d7ca0fdb4c9a req-df4d7bc0-cd4a-439c-8e57-1435eba5b6c8 tempest-TestStampPattern-1657532424 None] Deleting attachment 12f57b67-f583-4e6d-859a-2e0e3a05880e. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:57:53 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:57:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Flow 'volume_create_manager' (6bd2a55d-071a-4f0d-ad74-059e3daba294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f7b98c-0f8f-4e77-8145-a4c3410a5618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f7b98c-0f8f-4e77-8145-a4c3410a5618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1230036642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc1565a-67ba-4fa2-a193-dcd2b0df7551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a9ae81fd8c422099d06ff9417d267e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:54Z,use_quota=True,user_id='f5d29041fbf54986a42c87acf175be32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a417fd4-e833-4b7c-9227-5555c47979b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a417fd4-e833-4b7c-9227-5555c47979b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5f52eb-1c49-402b-a66c-347098717581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5f52eb-1c49-402b-a66c-347098717581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bc1565a-67ba-4fa2-a193-dcd2b0df7551', 'volume_name': 'volume-0bc1565a-67ba-4fa2-a193-dcd2b0df7551', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4646a1-52f7-4e84-9556-7a90516d5d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4646a1-52f7-4e84-9556-7a90516d5d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6104a1-25de-4e5b-bd8d-084e6d52bd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:53 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Volume 0bc1565a-67ba-4fa2-a193-dcd2b0df7551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bc1565a-67ba-4fa2-a193-dcd2b0df7551', 'volume_size': 1} Sep 07 13:57:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1230036642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc1565a-67ba-4fa2-a193-dcd2b0df7551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a9ae81fd8c422099d06ff9417d267e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:54Z,use_quota=True,user_id='f5d29041fbf54986a42c87acf175be32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:57:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Creating volume 0bc1565a-67ba-4fa2-a193-dcd2b0df7551 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:57:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:57:53 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:57:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0bc1565a-67ba-4fa2-a193-dcd2b0df7551 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:53 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0bc1565a-67ba-4fa2-a193-dcd2b0df7551 1073741824 Sep 07 13:57:53 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:54 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0bc1565a-67ba-4fa2-a193-dcd2b0df7551 1073741824" returned: 0 in 0.492s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0bc1565a-67ba-4fa2-a193-dcd2b0df7551 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:54 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0bc1565a-67ba-4fa2-a193-dcd2b0df7551 Sep 07 13:57:54 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:54 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0bc1565a-67ba-4fa2-a193-dcd2b0df7551" returned: 0 in 0.281s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:54 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:57:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6104a1-25de-4e5b-bd8d-084e6d52bd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bc1565a-67ba-4fa2-a193-dcd2b0df7551', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (993d3ee6-8bf6-4c03-8a87-3d60b3562914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:54 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Volume volume-0bc1565a-67ba-4fa2-a193-dcd2b0df7551 (0bc1565a-67ba-4fa2-a193-dcd2b0df7551): created successfully Sep 07 13:57:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (993d3ee6-8bf6-4c03-8a87-3d60b3562914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Flow 'volume_create_manager' (6bd2a55d-071a-4f0d-ad74-059e3daba294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:54 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-4b85434e-d672-4dbe-9d36-ae447c39aeec tempest-VolumesListAdminTestJSON-1198526720 None] Created volume successfully. Sep 07 13:57:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3c86ee36-c5da-40fb-9f1f-fc27bd6e5354 tempest-TestStampPattern-1657532424 None] Acquiring lock "cinder-60a3b847-206f-4404-9638-f44a20c88a62-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3c86ee36-c5da-40fb-9f1f-fc27bd6e5354 tempest-TestStampPattern-1657532424 None] Lock "cinder-60a3b847-206f-4404-9638-f44a20c88a62-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3c86ee36-c5da-40fb-9f1f-fc27bd6e5354 tempest-TestStampPattern-1657532424 None] Acquiring lock "cinder-quobyte-60a3b847-206f-4404-9638-f44a20c88a62" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3c86ee36-c5da-40fb-9f1f-fc27bd6e5354 tempest-TestStampPattern-1657532424 None] Lock "cinder-quobyte-60a3b847-206f-4404-9638-f44a20c88a62" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:55 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44b3915-0b2a-4e90-a0e8-3e7391105407]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:57:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c86ee36-c5da-40fb-9f1f-fc27bd6e5354 tempest-TestStampPattern-1657532424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-60a3b847-206f-4404-9638-f44a20c88a62 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:55 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-60a3b847-206f-4404-9638-f44a20c88a62 Sep 07 13:57:55 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:55 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c86ee36-c5da-40fb-9f1f-fc27bd6e5354 tempest-TestStampPattern-1657532424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-60a3b847-206f-4404-9638-f44a20c88a62" returned: 0 in 0.392s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c86ee36-c5da-40fb-9f1f-fc27bd6e5354 tempest-TestStampPattern-1657532424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-60a3b847-206f-4404-9638-f44a20c88a62 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:55 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-60a3b847-206f-4404-9638-f44a20c88a62 Sep 07 13:57:55 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:55 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c86ee36-c5da-40fb-9f1f-fc27bd6e5354 tempest-TestStampPattern-1657532424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-60a3b847-206f-4404-9638-f44a20c88a62" returned: 0 in 0.277s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3c86ee36-c5da-40fb-9f1f-fc27bd6e5354 tempest-TestStampPattern-1657532424 None] Lock "cinder-quobyte-60a3b847-206f-4404-9638-f44a20c88a62" released by "delete_volume" :: held 0.708s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:55 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-3c86ee36-c5da-40fb-9f1f-fc27bd6e5354 tempest-TestStampPattern-1657532424 None] Created reservations ['3ecd0016-baa8-4f42-9694-9708c5258b50', 'caaa0f5b-9395-4e95-83df-e21b76b2f78d', '832ff8f2-e2da-47a5-b0f9-d5a6e83ce0eb', '831166fa-4110-449f-837b-fdddb6236e62'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:57:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3c86ee36-c5da-40fb-9f1f-fc27bd6e5354 tempest-TestStampPattern-1657532424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3c86ee36-c5da-40fb-9f1f-fc27bd6e5354 tempest-TestStampPattern-1657532424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3c86ee36-c5da-40fb-9f1f-fc27bd6e5354 tempest-TestStampPattern-1657532424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3c86ee36-c5da-40fb-9f1f-fc27bd6e5354 tempest-TestStampPattern-1657532424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3c86ee36-c5da-40fb-9f1f-fc27bd6e5354 tempest-TestStampPattern-1657532424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c86ee36-c5da-40fb-9f1f-fc27bd6e5354 tempest-TestStampPattern-1657532424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:55 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:57:55 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:56 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c86ee36-c5da-40fb-9f1f-fc27bd6e5354 tempest-TestStampPattern-1657532424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.287s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-3c86ee36-c5da-40fb-9f1f-fc27bd6e5354 tempest-TestStampPattern-1657532424 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:57:56 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-3c86ee36-c5da-40fb-9f1f-fc27bd6e5354 tempest-TestStampPattern-1657532424 None] Deleted volume successfully. Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3c86ee36-c5da-40fb-9f1f-fc27bd6e5354 tempest-TestStampPattern-1657532424 None] Lock "cinder-60a3b847-206f-4404-9638-f44a20c88a62-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Flow 'volume_create_manager' (0c2dc12c-7b05-48fd-bdaa-bb507a571361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fdc2a15-5ba8-4eee-935e-80d8cbe4f20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fdc2a15-5ba8-4eee-935e-80d8cbe4f20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1487131821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c70e7f-4a13-4277-a0bb-a091b4db9164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a9ae81fd8c422099d06ff9417d267e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:56Z,use_quota=True,user_id='f5d29041fbf54986a42c87acf175be32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9afcea38-7d21-45f0-9e14-8c1f72c2a54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9afcea38-7d21-45f0-9e14-8c1f72c2a54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57878c0-4acb-4d7d-bda6-f5721bd58cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57878c0-4acb-4d7d-bda6-f5721bd58cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3c70e7f-4a13-4277-a0bb-a091b4db9164', 'volume_name': 'volume-c3c70e7f-4a13-4277-a0bb-a091b4db9164', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0840f0cb-036c-4e9c-8080-e34ce58879de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0840f0cb-036c-4e9c-8080-e34ce58879de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4099889b-df6a-4465-b31f-271ae1d1d852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:56 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Volume c3c70e7f-4a13-4277-a0bb-a091b4db9164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3c70e7f-4a13-4277-a0bb-a091b4db9164', 'volume_size': 1} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1487131821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c70e7f-4a13-4277-a0bb-a091b4db9164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a9ae81fd8c422099d06ff9417d267e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:56Z,use_quota=True,user_id='f5d29041fbf54986a42c87acf175be32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Creating volume c3c70e7f-4a13-4277-a0bb-a091b4db9164 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:57:56 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3c70e7f-4a13-4277-a0bb-a091b4db9164 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:56 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3c70e7f-4a13-4277-a0bb-a091b4db9164 1073741824 Sep 07 13:57:56 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f4546181-359c-4bec-9b75-8227e883b4c4 tempest-TestStampPattern-1657532424 None] Acquiring lock "cinder-1c9f7c55-8a0c-400f-98f9-f7cdd3259d71-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f4546181-359c-4bec-9b75-8227e883b4c4 tempest-TestStampPattern-1657532424 None] Lock "cinder-1c9f7c55-8a0c-400f-98f9-f7cdd3259d71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f4546181-359c-4bec-9b75-8227e883b4c4 tempest-TestStampPattern-1657532424 None] Acquiring lock "cinder-quobyte-c44cbd7c-ddae-4eec-8c88-78e4d645accb" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f4546181-359c-4bec-9b75-8227e883b4c4 tempest-TestStampPattern-1657532424 None] Lock "cinder-quobyte-c44cbd7c-ddae-4eec-8c88-78e4d645accb" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f4546181-359c-4bec-9b75-8227e883b4c4 tempest-TestStampPattern-1657532424 None] Acquiring lock "cinder-quobyte-1c9f7c55-8a0c-400f-98f9-f7cdd3259d71" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f4546181-359c-4bec-9b75-8227e883b4c4 tempest-TestStampPattern-1657532424 None] Lock "cinder-quobyte-1c9f7c55-8a0c-400f-98f9-f7cdd3259d71" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-f4546181-359c-4bec-9b75-8227e883b4c4 tempest-TestStampPattern-1657532424 None] Deleting offline snapshot 1c9f7c55-8a0c-400f-98f9-f7cdd3259d71 of volume c44cbd7c-ddae-4eec-8c88-78e4d645accb {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-f4546181-359c-4bec-9b75-8227e883b4c4 tempest-TestStampPattern-1657532424 None] snapshot_file for this snap is: volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.1c9f7c55-8a0c-400f-98f9-f7cdd3259d71 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4244a5b-bafb-4b12-9bdb-654a0a27b43d]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f4546181-359c-4bec-9b75-8227e883b4c4 tempest-TestStampPattern-1657532424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.1c9f7c55-8a0c-400f-98f9-f7cdd3259d71 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:56 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.1c9f7c55-8a0c-400f-98f9-f7cdd3259d71 Sep 07 13:57:56 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:56 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3c70e7f-4a13-4277-a0bb-a091b4db9164 1073741824" returned: 0 in 0.429s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3c70e7f-4a13-4277-a0bb-a091b4db9164 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:56 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3c70e7f-4a13-4277-a0bb-a091b4db9164 Sep 07 13:57:56 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:57 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f4546181-359c-4bec-9b75-8227e883b4c4 tempest-TestStampPattern-1657532424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.1c9f7c55-8a0c-400f-98f9-f7cdd3259d71" returned: 0 in 0.400s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-f4546181-359c-4bec-9b75-8227e883b4c4 tempest-TestStampPattern-1657532424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:57:57 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bae8244-7044-463a-8683-437c9b6962cb]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:57:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f4546181-359c-4bec-9b75-8227e883b4c4 tempest-TestStampPattern-1657532424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:57 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb Sep 07 13:57:57 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:57 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3c70e7f-4a13-4277-a0bb-a091b4db9164" returned: 0 in 0.253s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:57:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4099889b-df6a-4465-b31f-271ae1d1d852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3c70e7f-4a13-4277-a0bb-a091b4db9164', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfdb584-9145-407f-89af-7d5f64ae98b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:57 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Volume volume-c3c70e7f-4a13-4277-a0bb-a091b4db9164 (c3c70e7f-4a13-4277-a0bb-a091b4db9164): created successfully Sep 07 13:57:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfdb584-9145-407f-89af-7d5f64ae98b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Flow 'volume_create_manager' (0c2dc12c-7b05-48fd-bdaa-bb507a571361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:57 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-4ed21608-b535-450e-9adf-f9c885940aea tempest-VolumesListAdminTestJSON-1198526720 None] Created volume successfully. Sep 07 13:57:57 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f4546181-359c-4bec-9b75-8227e883b4c4 tempest-TestStampPattern-1657532424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb" returned: 0 in 0.566s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f4546181-359c-4bec-9b75-8227e883b4c4 tempest-TestStampPattern-1657532424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.1c9f7c55-8a0c-400f-98f9-f7cdd3259d71 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:57 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.1c9f7c55-8a0c-400f-98f9-f7cdd3259d71 Sep 07 13:57:57 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:57 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f4546181-359c-4bec-9b75-8227e883b4c4 tempest-TestStampPattern-1657532424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.1c9f7c55-8a0c-400f-98f9-f7cdd3259d71" returned: 0 in 0.340s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f4546181-359c-4bec-9b75-8227e883b4c4 tempest-TestStampPattern-1657532424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.1c9f7c55-8a0c-400f-98f9-f7cdd3259d71 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:57 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.1c9f7c55-8a0c-400f-98f9-f7cdd3259d71 Sep 07 13:57:57 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:58 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f4546181-359c-4bec-9b75-8227e883b4c4 tempest-TestStampPattern-1657532424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb.1c9f7c55-8a0c-400f-98f9-f7cdd3259d71" returned: 0 in 0.242s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f4546181-359c-4bec-9b75-8227e883b4c4 tempest-TestStampPattern-1657532424 None] Lock "cinder-quobyte-1c9f7c55-8a0c-400f-98f9-f7cdd3259d71" released by "_delete_snapshot" :: held 1.660s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f4546181-359c-4bec-9b75-8227e883b4c4 tempest-TestStampPattern-1657532424 None] Lock "cinder-quobyte-c44cbd7c-ddae-4eec-8c88-78e4d645accb" released by "delete_snapshot" :: held 1.680s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-f4546181-359c-4bec-9b75-8227e883b4c4 tempest-TestStampPattern-1657532424 None] Created reservations ['793f04a5-398a-43ab-848c-cb009e97e75a', '4873963c-f3c2-47fa-b301-0d894fb5994e', '0c47c780-bcdd-4bd9-842c-0c51bc7ea20d', '47721bb8-662f-48ae-9c70-4ebcacf4899a'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:57:58 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-f4546181-359c-4bec-9b75-8227e883b4c4 tempest-TestStampPattern-1657532424 None] Delete snapshot completed successfully. Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f4546181-359c-4bec-9b75-8227e883b4c4 tempest-TestStampPattern-1657532424 None] Lock "cinder-1c9f7c55-8a0c-400f-98f9-f7cdd3259d71-delete_snapshot" released by "delete_snapshot" :: held 1.820s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Flow 'volume_create_manager' (2df28015-5568-4ff2-b901-d0448868aaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39f216cf-6a86-442d-8ff3-2cb9b5c793ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39f216cf-6a86-442d-8ff3-2cb9b5c793ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1777836585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=014aca73-bd29-4a56-80da-d92f068ea2df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a9ae81fd8c422099d06ff9417d267e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:59Z,use_quota=True,user_id='f5d29041fbf54986a42c87acf175be32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679bb4dc-1b36-443b-9cd7-52ec75b6d83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679bb4dc-1b36-443b-9cd7-52ec75b6d83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd5f110-d40e-408c-b97d-de5972aa73f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd5f110-d40e-408c-b97d-de5972aa73f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '014aca73-bd29-4a56-80da-d92f068ea2df', 'volume_name': 'volume-014aca73-bd29-4a56-80da-d92f068ea2df', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f026aad8-1073-4983-883a-ad1224d473ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f026aad8-1073-4983-883a-ad1224d473ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1262a2f3-9495-47d6-86b1-6a24f3bbc0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:58 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Volume 014aca73-bd29-4a56-80da-d92f068ea2df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-014aca73-bd29-4a56-80da-d92f068ea2df', 'volume_size': 1} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1777836585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=014aca73-bd29-4a56-80da-d92f068ea2df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a9ae81fd8c422099d06ff9417d267e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:59Z,use_quota=True,user_id='f5d29041fbf54986a42c87acf175be32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Creating volume 014aca73-bd29-4a56-80da-d92f068ea2df {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:57:58 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:57:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-014aca73-bd29-4a56-80da-d92f068ea2df 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:59 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-014aca73-bd29-4a56-80da-d92f068ea2df 1073741824 Sep 07 13:57:59 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:59 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-014aca73-bd29-4a56-80da-d92f068ea2df 1073741824" returned: 0 in 0.486s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-014aca73-bd29-4a56-80da-d92f068ea2df {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:59 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-014aca73-bd29-4a56-80da-d92f068ea2df Sep 07 13:57:59 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:59 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-014aca73-bd29-4a56-80da-d92f068ea2df" returned: 0 in 0.373s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:59 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:57:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:59 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1262a2f3-9495-47d6-86b1-6a24f3bbc0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-014aca73-bd29-4a56-80da-d92f068ea2df', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:59 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c471ebc-0a2c-4e28-948f-eb9b1b55cdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:59 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Volume volume-014aca73-bd29-4a56-80da-d92f068ea2df (014aca73-bd29-4a56-80da-d92f068ea2df): created successfully Sep 07 13:57:59 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c471ebc-0a2c-4e28-948f-eb9b1b55cdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:59 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Flow 'volume_create_manager' (2df28015-5568-4ff2-b901-d0448868aaa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:59 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-5e01fb09-42d8-440a-b799-09d9cf5a8120 tempest-VolumesListAdminTestJSON-1198526720 None] Created volume successfully. Sep 07 13:58:01 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:58:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Flow 'volume_create_manager' (7364c4f0-0393-4944-999f-c8d856becdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85079208-2e1c-45df-aebc-6043fe26d9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85079208-2e1c-45df-aebc-6043fe26d9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7dba892-4556-4867-8705-ce177a1fe037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d8ebb6869e4691843d07c1406bf68b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:02Z,use_quota=True,user_id='d05636c6e6624daf92a23c752573e5a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc457a29-c574-42e2-8217-3d9e63d55c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc457a29-c574-42e2-8217-3d9e63d55c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550289ee-0a84-487b-a5b0-a19271b4ca0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550289ee-0a84-487b-a5b0-a19271b4ca0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7dba892-4556-4867-8705-ce177a1fe037', 'volume_name': 'volume-b7dba892-4556-4867-8705-ce177a1fe037', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498b2483-3b5e-4a9b-b500-48c515ad7ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498b2483-3b5e-4a9b-b500-48c515ad7ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ac71da-27ae-42d2-9683-0a99f00a5d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:01 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Volume b7dba892-4556-4867-8705-ce177a1fe037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7dba892-4556-4867-8705-ce177a1fe037', 'volume_size': 1} Sep 07 13:58:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7dba892-4556-4867-8705-ce177a1fe037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d8ebb6869e4691843d07c1406bf68b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:02Z,use_quota=True,user_id='d05636c6e6624daf92a23c752573e5a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Creating volume b7dba892-4556-4867-8705-ce177a1fe037 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:01 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:58:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b7dba892-4556-4867-8705-ce177a1fe037 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:02 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b7dba892-4556-4867-8705-ce177a1fe037 1073741824 Sep 07 13:58:02 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-475a48c7-99bb-4049-88f1-a5c2df717e95 tempest-TestStampPattern-1657532424 None] Acquiring lock "cinder-c44cbd7c-ddae-4eec-8c88-78e4d645accb-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-475a48c7-99bb-4049-88f1-a5c2df717e95 tempest-TestStampPattern-1657532424 None] Lock "cinder-c44cbd7c-ddae-4eec-8c88-78e4d645accb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:02 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b7dba892-4556-4867-8705-ce177a1fe037 1073741824" returned: 0 in 0.474s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-475a48c7-99bb-4049-88f1-a5c2df717e95 tempest-TestStampPattern-1657532424 None] Acquiring lock "cinder-quobyte-c44cbd7c-ddae-4eec-8c88-78e4d645accb" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-475a48c7-99bb-4049-88f1-a5c2df717e95 tempest-TestStampPattern-1657532424 None] Lock "cinder-quobyte-c44cbd7c-ddae-4eec-8c88-78e4d645accb" acquired by "delete_volume" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b7dba892-4556-4867-8705-ce177a1fe037 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:02 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bfd595-8e89-4073-a491-a122e7cb4c96]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-475a48c7-99bb-4049-88f1-a5c2df717e95 tempest-TestStampPattern-1657532424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:02 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b7dba892-4556-4867-8705-ce177a1fe037 Sep 07 13:58:02 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:02 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb Sep 07 13:58:02 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:02 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b7dba892-4556-4867-8705-ce177a1fe037" returned: 0 in 0.252s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ac71da-27ae-42d2-9683-0a99f00a5d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7dba892-4556-4867-8705-ce177a1fe037', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ffbe0c-0769-4cd8-b5d3-66cea3be4100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:02 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Volume volume-b7dba892-4556-4867-8705-ce177a1fe037 (b7dba892-4556-4867-8705-ce177a1fe037): created successfully Sep 07 13:58:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ffbe0c-0769-4cd8-b5d3-66cea3be4100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Flow 'volume_create_manager' (7364c4f0-0393-4944-999f-c8d856becdcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:02 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-52fb77cf-47b7-4621-9de0-43c8f5c1e31a tempest-VolumesListAdminTestJSON-827411886 None] Created volume successfully. Sep 07 13:58:02 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-475a48c7-99bb-4049-88f1-a5c2df717e95 tempest-TestStampPattern-1657532424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb" returned: 0 in 0.382s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-475a48c7-99bb-4049-88f1-a5c2df717e95 tempest-TestStampPattern-1657532424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:02 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb Sep 07 13:58:02 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:03 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-475a48c7-99bb-4049-88f1-a5c2df717e95 tempest-TestStampPattern-1657532424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c44cbd7c-ddae-4eec-8c88-78e4d645accb" returned: 0 in 0.256s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:03 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-475a48c7-99bb-4049-88f1-a5c2df717e95 tempest-TestStampPattern-1657532424 None] Lock "cinder-quobyte-c44cbd7c-ddae-4eec-8c88-78e4d645accb" released by "delete_volume" :: held 0.704s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:03 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-475a48c7-99bb-4049-88f1-a5c2df717e95 tempest-TestStampPattern-1657532424 None] Created reservations ['99b0f649-c0f6-4c6e-913b-0081a0d1f8b3', 'e822d6cf-6cf0-40b5-a266-cd480a011b7c', 'd0016da7-0ef6-429d-b613-53433a91bdc2', '757a0d13-c959-4e7f-958f-78470fb1b56b'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-475a48c7-99bb-4049-88f1-a5c2df717e95 tempest-TestStampPattern-1657532424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-475a48c7-99bb-4049-88f1-a5c2df717e95 tempest-TestStampPattern-1657532424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:03 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-475a48c7-99bb-4049-88f1-a5c2df717e95 tempest-TestStampPattern-1657532424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:03 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-475a48c7-99bb-4049-88f1-a5c2df717e95 tempest-TestStampPattern-1657532424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-475a48c7-99bb-4049-88f1-a5c2df717e95 tempest-TestStampPattern-1657532424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-475a48c7-99bb-4049-88f1-a5c2df717e95 tempest-TestStampPattern-1657532424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:03 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:58:03 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:03 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-475a48c7-99bb-4049-88f1-a5c2df717e95 tempest-TestStampPattern-1657532424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.259s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:03 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-475a48c7-99bb-4049-88f1-a5c2df717e95 tempest-TestStampPattern-1657532424 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:03 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-475a48c7-99bb-4049-88f1-a5c2df717e95 tempest-TestStampPattern-1657532424 None] Deleted volume successfully. Sep 07 13:58:03 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-475a48c7-99bb-4049-88f1-a5c2df717e95 tempest-TestStampPattern-1657532424 None] Lock "cinder-c44cbd7c-ddae-4eec-8c88-78e4d645accb-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3c584644-d354-4bf8-8141-36dba751dd26 tempest-VolumesListAdminTestJSON-827411886 None] Acquiring lock "cinder-b7dba892-4556-4867-8705-ce177a1fe037-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3c584644-d354-4bf8-8141-36dba751dd26 tempest-VolumesListAdminTestJSON-827411886 None] Lock "cinder-b7dba892-4556-4867-8705-ce177a1fe037-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3c584644-d354-4bf8-8141-36dba751dd26 tempest-VolumesListAdminTestJSON-827411886 None] Acquiring lock "cinder-quobyte-b7dba892-4556-4867-8705-ce177a1fe037" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3c584644-d354-4bf8-8141-36dba751dd26 tempest-VolumesListAdminTestJSON-827411886 None] Lock "cinder-quobyte-b7dba892-4556-4867-8705-ce177a1fe037" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:04 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[158ec11e-eff0-4571-858e-16f46e28c61f]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c584644-d354-4bf8-8141-36dba751dd26 tempest-VolumesListAdminTestJSON-827411886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b7dba892-4556-4867-8705-ce177a1fe037 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2a86839d-1b01-4bfa-b6bf-ba8ef0a94917 tempest-VolumesListAdminTestJSON-1198526720 None] Acquiring lock "cinder-014aca73-bd29-4a56-80da-d92f068ea2df-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2a86839d-1b01-4bfa-b6bf-ba8ef0a94917 tempest-VolumesListAdminTestJSON-1198526720 None] Lock "cinder-014aca73-bd29-4a56-80da-d92f068ea2df-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2a86839d-1b01-4bfa-b6bf-ba8ef0a94917 tempest-VolumesListAdminTestJSON-1198526720 None] Acquiring lock "cinder-quobyte-014aca73-bd29-4a56-80da-d92f068ea2df" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2a86839d-1b01-4bfa-b6bf-ba8ef0a94917 tempest-VolumesListAdminTestJSON-1198526720 None] Lock "cinder-quobyte-014aca73-bd29-4a56-80da-d92f068ea2df" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:04 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b7dba892-4556-4867-8705-ce177a1fe037 Sep 07 13:58:04 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:04 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe12187-b37d-47b8-8fa5-23117afd5cf9]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2a86839d-1b01-4bfa-b6bf-ba8ef0a94917 tempest-VolumesListAdminTestJSON-1198526720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-014aca73-bd29-4a56-80da-d92f068ea2df {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:04 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-014aca73-bd29-4a56-80da-d92f068ea2df Sep 07 13:58:04 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:04 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c584644-d354-4bf8-8141-36dba751dd26 tempest-VolumesListAdminTestJSON-827411886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b7dba892-4556-4867-8705-ce177a1fe037" returned: 0 in 0.454s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c584644-d354-4bf8-8141-36dba751dd26 tempest-VolumesListAdminTestJSON-827411886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b7dba892-4556-4867-8705-ce177a1fe037 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:04 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b7dba892-4556-4867-8705-ce177a1fe037 Sep 07 13:58:04 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:04 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2a86839d-1b01-4bfa-b6bf-ba8ef0a94917 tempest-VolumesListAdminTestJSON-1198526720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-014aca73-bd29-4a56-80da-d92f068ea2df" returned: 0 in 0.379s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2a86839d-1b01-4bfa-b6bf-ba8ef0a94917 tempest-VolumesListAdminTestJSON-1198526720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-014aca73-bd29-4a56-80da-d92f068ea2df {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:04 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-014aca73-bd29-4a56-80da-d92f068ea2df Sep 07 13:58:04 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:04 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c584644-d354-4bf8-8141-36dba751dd26 tempest-VolumesListAdminTestJSON-827411886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b7dba892-4556-4867-8705-ce177a1fe037" returned: 0 in 0.314s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3c584644-d354-4bf8-8141-36dba751dd26 tempest-VolumesListAdminTestJSON-827411886 None] Lock "cinder-quobyte-b7dba892-4556-4867-8705-ce177a1fe037" released by "delete_volume" :: held 0.826s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-3c584644-d354-4bf8-8141-36dba751dd26 tempest-VolumesListAdminTestJSON-827411886 None] Created reservations ['6fbf66f6-1a6f-4187-a8c3-25a576b16bfd', '3322fb0d-69e2-4d39-a274-4fa3dfb02a9c', '2c0a8cbf-b3e9-4560-9dd9-a1c3385542d4', '77060a5b-a1ea-46aa-8b95-9e73488d7467'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:05 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2a86839d-1b01-4bfa-b6bf-ba8ef0a94917 tempest-VolumesListAdminTestJSON-1198526720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-014aca73-bd29-4a56-80da-d92f068ea2df" returned: 0 in 0.320s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2a86839d-1b01-4bfa-b6bf-ba8ef0a94917 tempest-VolumesListAdminTestJSON-1198526720 None] Lock "cinder-quobyte-014aca73-bd29-4a56-80da-d92f068ea2df" released by "delete_volume" :: held 0.765s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3c584644-d354-4bf8-8141-36dba751dd26 tempest-VolumesListAdminTestJSON-827411886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3c584644-d354-4bf8-8141-36dba751dd26 tempest-VolumesListAdminTestJSON-827411886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3c584644-d354-4bf8-8141-36dba751dd26 tempest-VolumesListAdminTestJSON-827411886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3c584644-d354-4bf8-8141-36dba751dd26 tempest-VolumesListAdminTestJSON-827411886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3c584644-d354-4bf8-8141-36dba751dd26 tempest-VolumesListAdminTestJSON-827411886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c584644-d354-4bf8-8141-36dba751dd26 tempest-VolumesListAdminTestJSON-827411886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-2a86839d-1b01-4bfa-b6bf-ba8ef0a94917 tempest-VolumesListAdminTestJSON-1198526720 None] Created reservations ['ce0d7934-5a5a-4f13-80e4-db8b10d22794', '496706fc-4f47-409f-9d8e-6334933aab1f', 'dbba6f4a-fd80-49c5-ab14-079bcb1f7cbe', '6bc64295-339e-40fb-93e0-b0180bba498c'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:05 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:58:05 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2a86839d-1b01-4bfa-b6bf-ba8ef0a94917 tempest-VolumesListAdminTestJSON-1198526720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2a86839d-1b01-4bfa-b6bf-ba8ef0a94917 tempest-VolumesListAdminTestJSON-1198526720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2a86839d-1b01-4bfa-b6bf-ba8ef0a94917 tempest-VolumesListAdminTestJSON-1198526720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2a86839d-1b01-4bfa-b6bf-ba8ef0a94917 tempest-VolumesListAdminTestJSON-1198526720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2a86839d-1b01-4bfa-b6bf-ba8ef0a94917 tempest-VolumesListAdminTestJSON-1198526720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2a86839d-1b01-4bfa-b6bf-ba8ef0a94917 tempest-VolumesListAdminTestJSON-1198526720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:05 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:58:05 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c281c8ff-fbeb-4f86-992a-425a70f1ee33 tempest-VolumesListAdminTestJSON-1198526720 None] Acquiring lock "cinder-c3c70e7f-4a13-4277-a0bb-a091b4db9164-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:05 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c281c8ff-fbeb-4f86-992a-425a70f1ee33 tempest-VolumesListAdminTestJSON-1198526720 None] Lock "cinder-c3c70e7f-4a13-4277-a0bb-a091b4db9164-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3c584644-d354-4bf8-8141-36dba751dd26 tempest-VolumesListAdminTestJSON-827411886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.328s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-3c584644-d354-4bf8-8141-36dba751dd26 tempest-VolumesListAdminTestJSON-827411886 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:05 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-3c584644-d354-4bf8-8141-36dba751dd26 tempest-VolumesListAdminTestJSON-827411886 None] Deleted volume successfully. Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3c584644-d354-4bf8-8141-36dba751dd26 tempest-VolumesListAdminTestJSON-827411886 None] Lock "cinder-b7dba892-4556-4867-8705-ce177a1fe037-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c281c8ff-fbeb-4f86-992a-425a70f1ee33 tempest-VolumesListAdminTestJSON-1198526720 None] Acquiring lock "cinder-quobyte-c3c70e7f-4a13-4277-a0bb-a091b4db9164" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c281c8ff-fbeb-4f86-992a-425a70f1ee33 tempest-VolumesListAdminTestJSON-1198526720 None] Lock "cinder-quobyte-c3c70e7f-4a13-4277-a0bb-a091b4db9164" acquired by "delete_volume" :: waited 0.019s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5722b9ae-ded9-4ec6-af17-05359c7f8735]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c281c8ff-fbeb-4f86-992a-425a70f1ee33 tempest-VolumesListAdminTestJSON-1198526720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3c70e7f-4a13-4277-a0bb-a091b4db9164 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:05 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2a86839d-1b01-4bfa-b6bf-ba8ef0a94917 tempest-VolumesListAdminTestJSON-1198526720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.321s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-2a86839d-1b01-4bfa-b6bf-ba8ef0a94917 tempest-VolumesListAdminTestJSON-1198526720 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:05 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-2a86839d-1b01-4bfa-b6bf-ba8ef0a94917 tempest-VolumesListAdminTestJSON-1198526720 None] Deleted volume successfully. Sep 07 13:58:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2a86839d-1b01-4bfa-b6bf-ba8ef0a94917 tempest-VolumesListAdminTestJSON-1198526720 None] Lock "cinder-014aca73-bd29-4a56-80da-d92f068ea2df-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:05 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3c70e7f-4a13-4277-a0bb-a091b4db9164 Sep 07 13:58:05 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:06 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c281c8ff-fbeb-4f86-992a-425a70f1ee33 tempest-VolumesListAdminTestJSON-1198526720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3c70e7f-4a13-4277-a0bb-a091b4db9164" returned: 0 in 0.370s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c281c8ff-fbeb-4f86-992a-425a70f1ee33 tempest-VolumesListAdminTestJSON-1198526720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3c70e7f-4a13-4277-a0bb-a091b4db9164 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:06 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3c70e7f-4a13-4277-a0bb-a091b4db9164 Sep 07 13:58:06 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:06 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c281c8ff-fbeb-4f86-992a-425a70f1ee33 tempest-VolumesListAdminTestJSON-1198526720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3c70e7f-4a13-4277-a0bb-a091b4db9164" returned: 0 in 0.252s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:06 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c281c8ff-fbeb-4f86-992a-425a70f1ee33 tempest-VolumesListAdminTestJSON-1198526720 None] Lock "cinder-quobyte-c3c70e7f-4a13-4277-a0bb-a091b4db9164" released by "delete_volume" :: held 0.669s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:06 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-c281c8ff-fbeb-4f86-992a-425a70f1ee33 tempest-VolumesListAdminTestJSON-1198526720 None] Created reservations ['e50de1dc-6cb8-43fa-a953-1b5b6675d97c', '5975f0ef-aec2-4153-ac09-c1beca9a8bde', 'a6d2dd5c-3066-4f29-a6dc-1b05aefb7433', 'bedaf631-fc12-437f-b8af-31e9c8fb8d59'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c281c8ff-fbeb-4f86-992a-425a70f1ee33 tempest-VolumesListAdminTestJSON-1198526720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c281c8ff-fbeb-4f86-992a-425a70f1ee33 tempest-VolumesListAdminTestJSON-1198526720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c281c8ff-fbeb-4f86-992a-425a70f1ee33 tempest-VolumesListAdminTestJSON-1198526720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c281c8ff-fbeb-4f86-992a-425a70f1ee33 tempest-VolumesListAdminTestJSON-1198526720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c281c8ff-fbeb-4f86-992a-425a70f1ee33 tempest-VolumesListAdminTestJSON-1198526720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c281c8ff-fbeb-4f86-992a-425a70f1ee33 tempest-VolumesListAdminTestJSON-1198526720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:06 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:58:06 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:06 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c281c8ff-fbeb-4f86-992a-425a70f1ee33 tempest-VolumesListAdminTestJSON-1198526720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.271s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:06 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-c281c8ff-fbeb-4f86-992a-425a70f1ee33 tempest-VolumesListAdminTestJSON-1198526720 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:06 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c281c8ff-fbeb-4f86-992a-425a70f1ee33 tempest-VolumesListAdminTestJSON-1198526720 None] Deleted volume successfully. Sep 07 13:58:06 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c281c8ff-fbeb-4f86-992a-425a70f1ee33 tempest-VolumesListAdminTestJSON-1198526720 None] Lock "cinder-c3c70e7f-4a13-4277-a0bb-a091b4db9164-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:06 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a6f72c08-2ee0-4d57-aef0-66544317bd1f tempest-VolumesListAdminTestJSON-1198526720 None] Acquiring lock "cinder-0bc1565a-67ba-4fa2-a193-dcd2b0df7551-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:06 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a6f72c08-2ee0-4d57-aef0-66544317bd1f tempest-VolumesListAdminTestJSON-1198526720 None] Lock "cinder-0bc1565a-67ba-4fa2-a193-dcd2b0df7551-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:06 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a6f72c08-2ee0-4d57-aef0-66544317bd1f tempest-VolumesListAdminTestJSON-1198526720 None] Acquiring lock "cinder-quobyte-0bc1565a-67ba-4fa2-a193-dcd2b0df7551" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:06 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a6f72c08-2ee0-4d57-aef0-66544317bd1f tempest-VolumesListAdminTestJSON-1198526720 None] Lock "cinder-quobyte-0bc1565a-67ba-4fa2-a193-dcd2b0df7551" acquired by "delete_volume" :: waited 0.015s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:06 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d516ded8-919c-4841-b469-ae40fec7e11a]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a6f72c08-2ee0-4d57-aef0-66544317bd1f tempest-VolumesListAdminTestJSON-1198526720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0bc1565a-67ba-4fa2-a193-dcd2b0df7551 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:06 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0bc1565a-67ba-4fa2-a193-dcd2b0df7551 Sep 07 13:58:06 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:07 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a6f72c08-2ee0-4d57-aef0-66544317bd1f tempest-VolumesListAdminTestJSON-1198526720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0bc1565a-67ba-4fa2-a193-dcd2b0df7551" returned: 0 in 0.348s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a6f72c08-2ee0-4d57-aef0-66544317bd1f tempest-VolumesListAdminTestJSON-1198526720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0bc1565a-67ba-4fa2-a193-dcd2b0df7551 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:07 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0bc1565a-67ba-4fa2-a193-dcd2b0df7551 Sep 07 13:58:07 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:07 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a6f72c08-2ee0-4d57-aef0-66544317bd1f tempest-VolumesListAdminTestJSON-1198526720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0bc1565a-67ba-4fa2-a193-dcd2b0df7551" returned: 0 in 0.236s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:07 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a6f72c08-2ee0-4d57-aef0-66544317bd1f tempest-VolumesListAdminTestJSON-1198526720 None] Lock "cinder-quobyte-0bc1565a-67ba-4fa2-a193-dcd2b0df7551" released by "delete_volume" :: held 0.625s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:07 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-a6f72c08-2ee0-4d57-aef0-66544317bd1f tempest-VolumesListAdminTestJSON-1198526720 None] Created reservations ['3fe865d0-f003-49d9-979b-c4406d27b3a1', '322d2a3a-4e56-4b4f-9def-3799b7e0ea44', 'e5e5e650-c6c2-4554-a54a-9206514ad38d', 'f3700754-cb0c-409d-95f0-30277e1f40ee'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a6f72c08-2ee0-4d57-aef0-66544317bd1f tempest-VolumesListAdminTestJSON-1198526720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a6f72c08-2ee0-4d57-aef0-66544317bd1f tempest-VolumesListAdminTestJSON-1198526720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a6f72c08-2ee0-4d57-aef0-66544317bd1f tempest-VolumesListAdminTestJSON-1198526720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a6f72c08-2ee0-4d57-aef0-66544317bd1f tempest-VolumesListAdminTestJSON-1198526720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a6f72c08-2ee0-4d57-aef0-66544317bd1f tempest-VolumesListAdminTestJSON-1198526720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a6f72c08-2ee0-4d57-aef0-66544317bd1f tempest-VolumesListAdminTestJSON-1198526720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:07 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:58:07 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:07 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a6f72c08-2ee0-4d57-aef0-66544317bd1f tempest-VolumesListAdminTestJSON-1198526720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.296s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:07 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-a6f72c08-2ee0-4d57-aef0-66544317bd1f tempest-VolumesListAdminTestJSON-1198526720 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:07 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-a6f72c08-2ee0-4d57-aef0-66544317bd1f tempest-VolumesListAdminTestJSON-1198526720 None] Deleted volume successfully. Sep 07 13:58:07 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a6f72c08-2ee0-4d57-aef0-66544317bd1f tempest-VolumesListAdminTestJSON-1198526720 None] Lock "cinder-0bc1565a-67ba-4fa2-a193-dcd2b0df7551-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Flow 'volume_create_manager' (882f56a8-1e6a-44e2-98fb-1eaa400ac412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1631b54-d714-420d-8dc6-7e37a8ce72ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1631b54-d714-420d-8dc6-7e37a8ce72ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2024999751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73531f87-f949-4685-8967-ed0709aa55b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73205a42f1fc48139b386fb334303d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:16Z,use_quota=True,user_id='47a8b5814215416084cbbbcfa6accb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3565400f-8acb-46cc-aa54-cc8c31231403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3565400f-8acb-46cc-aa54-cc8c31231403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b633f1f5-f36f-4b1e-b605-2426f6858672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b633f1f5-f36f-4b1e-b605-2426f6858672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73531f87-f949-4685-8967-ed0709aa55b8', 'volume_name': 'volume-73531f87-f949-4685-8967-ed0709aa55b8', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896b0808-acf4-468a-9369-36c97bad04e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896b0808-acf4-468a-9369-36c97bad04e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6349897a-0ffe-4ced-b3d7-d0cb753002b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:16 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Volume 73531f87-f949-4685-8967-ed0709aa55b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73531f87-f949-4685-8967-ed0709aa55b8', 'volume_size': 1} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2024999751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73531f87-f949-4685-8967-ed0709aa55b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73205a42f1fc48139b386fb334303d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:16Z,use_quota=True,user_id='47a8b5814215416084cbbbcfa6accb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Creating volume 73531f87-f949-4685-8967-ed0709aa55b8 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:16 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:16 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8 1073741824 Sep 07 13:58:16 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Flow 'volume_create_manager' (e3877bb3-3ca8-4716-935d-f377e042fb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498b1021-e049-4f76-9dd2-ae87039510d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498b1021-e049-4f76-9dd2-ae87039510d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1719156591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9e6f59-c34b-4194-883e-d90c60cf173e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a8e0fb2d89e43bf8b91797f95fc56eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:17Z,use_quota=True,user_id='ff929681ad7446a9b6ef0d874331badd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe764e3b-92ea-4e62-a777-7616227c4306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe764e3b-92ea-4e62-a777-7616227c4306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a61a9d6-9cbe-495b-84f9-7f3a41136d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a61a9d6-9cbe-495b-84f9-7f3a41136d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf9e6f59-c34b-4194-883e-d90c60cf173e', 'volume_name': 'volume-cf9e6f59-c34b-4194-883e-d90c60cf173e', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbff035-b7c5-46f2-8992-93f2e837b819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbff035-b7c5-46f2-8992-93f2e837b819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c43207-936f-4d7e-8676-afb8d57a0771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:16 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Volume cf9e6f59-c34b-4194-883e-d90c60cf173e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf9e6f59-c34b-4194-883e-d90c60cf173e', 'volume_size': 1} Sep 07 13:58:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:17 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8 1073741824" returned: 0 in 0.403s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:17 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8 Sep 07 13:58:17 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:17 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8" returned: 0 in 0.304s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:17 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.620s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:17 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1719156591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9e6f59-c34b-4194-883e-d90c60cf173e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a8e0fb2d89e43bf8b91797f95fc56eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:17Z,use_quota=True,user_id='ff929681ad7446a9b6ef0d874331badd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:17 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Creating volume cf9e6f59-c34b-4194-883e-d90c60cf173e {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:17 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:17 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:17 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:17 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:58:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6349897a-0ffe-4ced-b3d7-d0cb753002b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73531f87-f949-4685-8967-ed0709aa55b8', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a499d9a-c732-433d-a553-bcc50bc46792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:17 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e 1073741824 Sep 07 13:58:17 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:17 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Volume volume-73531f87-f949-4685-8967-ed0709aa55b8 (73531f87-f949-4685-8967-ed0709aa55b8): created successfully Sep 07 13:58:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a499d9a-c732-433d-a553-bcc50bc46792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Flow 'volume_create_manager' (882f56a8-1e6a-44e2-98fb-1eaa400ac412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:17 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-b083b9d4-3bce-4b77-bd36-80d6fd010e11 tempest-CreateVolumesFromSnapshotTest-487226501 None] Created volume successfully. Sep 07 13:58:17 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e 1073741824" returned: 0 in 0.420s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:17 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e Sep 07 13:58:17 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:18 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e" returned: 0 in 0.265s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c43207-936f-4d7e-8676-afb8d57a0771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf9e6f59-c34b-4194-883e-d90c60cf173e', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af1d949-8f6b-47b4-af49-f5f4a053be18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:18 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Volume volume-cf9e6f59-c34b-4194-883e-d90c60cf173e (cf9e6f59-c34b-4194-883e-d90c60cf173e): created successfully Sep 07 13:58:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af1d949-8f6b-47b4-af49-f5f4a053be18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Flow 'volume_create_manager' (e3877bb3-3ca8-4716-935d-f377e042fb60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:18 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-bf587aa8-55c6-4992-9827-7200e591162b tempest-SnapshotMetadataTestJSON-1081581944 None] Created volume successfully. Sep 07 13:58:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-33b671af-ad53-4085-a9c8-cc5e8fee8437 tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-33b671af-ad53-4085-a9c8-cc5e8fee8437 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-33b671af-ad53-4085-a9c8-cc5e8fee8437 tempest-CreateVolumesFromSnapshotTest-487226501 None] Creating offline snapshot f6fcee42-7bba-46ac-b34e-fab0675c6128 of volume 73531f87-f949-4685-8967-ed0709aa55b8 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:58:18 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3243f164-7bab-4380-a957-69873e242b06]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33b671af-ad53-4085-a9c8-cc5e8fee8437 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fd05a478-55df-4594-b8e1-4099e3bcf73e tempest-SnapshotMetadataTestJSON-1081581944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:18 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8 Sep 07 13:58:18 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:19 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33b671af-ad53-4085-a9c8-cc5e8fee8437 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8" returned: 0 in 0.350s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33b671af-ad53-4085-a9c8-cc5e8fee8437 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.f6fcee42-7bba-46ac-b34e-fab0675c6128 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:19 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.f6fcee42-7bba-46ac-b34e-fab0675c6128 1G Sep 07 13:58:19 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:19 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33b671af-ad53-4085-a9c8-cc5e8fee8437 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.f6fcee42-7bba-46ac-b34e-fab0675c6128 1G" returned: 0 in 0.374s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33b671af-ad53-4085-a9c8-cc5e8fee8437 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73531f87-f949-4685-8967-ed0709aa55b8 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.f6fcee42-7bba-46ac-b34e-fab0675c6128 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:19 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73531f87-f949-4685-8967-ed0709aa55b8 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.f6fcee42-7bba-46ac-b34e-fab0675c6128 Sep 07 13:58:19 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:19 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33b671af-ad53-4085-a9c8-cc5e8fee8437 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73531f87-f949-4685-8967-ed0709aa55b8 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.f6fcee42-7bba-46ac-b34e-fab0675c6128" returned: 0 in 0.301s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:19 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-33b671af-ad53-4085-a9c8-cc5e8fee8437 tempest-CreateVolumesFromSnapshotTest-487226501 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.f6fcee42-7bba-46ac-b34e-fab0675c6128 is being set with open permissions: ugo+rw Sep 07 13:58:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33b671af-ad53-4085-a9c8-cc5e8fee8437 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.f6fcee42-7bba-46ac-b34e-fab0675c6128 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:19 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.f6fcee42-7bba-46ac-b34e-fab0675c6128 Sep 07 13:58:19 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:19 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33b671af-ad53-4085-a9c8-cc5e8fee8437 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.f6fcee42-7bba-46ac-b34e-fab0675c6128" returned: 0 in 0.235s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33b671af-ad53-4085-a9c8-cc5e8fee8437 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:20 devstack sudo[104600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.info Sep 07 13:58:20 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:20 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33b671af-ad53-4085-a9c8-cc5e8fee8437 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.info" returned: 0 in 0.242s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:20 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-33b671af-ad53-4085-a9c8-cc5e8fee8437 tempest-CreateVolumesFromSnapshotTest-487226501 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.info is being set with open permissions: ugo+rw Sep 07 13:58:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33b671af-ad53-4085-a9c8-cc5e8fee8437 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:20 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.info Sep 07 13:58:20 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:20 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33b671af-ad53-4085-a9c8-cc5e8fee8437 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.info" returned: 0 in 0.245s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-33b671af-ad53-4085-a9c8-cc5e8fee8437 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.842s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fd05a478-55df-4594-b8e1-4099e3bcf73e tempest-SnapshotMetadataTestJSON-1081581944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.773s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-fd05a478-55df-4594-b8e1-4099e3bcf73e tempest-SnapshotMetadataTestJSON-1081581944 None] Creating offline snapshot 775c41f2-b234-44e0-832d-bba4da71edb0 of volume cf9e6f59-c34b-4194-883e-d90c60cf173e {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:58:20 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-33b671af-ad53-4085-a9c8-cc5e8fee8437 tempest-CreateVolumesFromSnapshotTest-487226501 None] Create snapshot completed successfully Sep 07 13:58:20 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[55453c93-afd4-478c-aa57-a0cc35394bbc]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fd05a478-55df-4594-b8e1-4099e3bcf73e tempest-SnapshotMetadataTestJSON-1081581944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:20 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e Sep 07 13:58:20 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:20 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fd05a478-55df-4594-b8e1-4099e3bcf73e tempest-SnapshotMetadataTestJSON-1081581944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e" returned: 0 in 0.385s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fd05a478-55df-4594-b8e1-4099e3bcf73e tempest-SnapshotMetadataTestJSON-1081581944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.775c41f2-b234-44e0-832d-bba4da71edb0 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:20 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.775c41f2-b234-44e0-832d-bba4da71edb0 1G Sep 07 13:58:20 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Flow 'volume_create_manager' (ce7d70d8-43ba-4283-b68b-cc9b129443c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d60fbb-deaf-47f3-abfc-f8b56425f103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d60fbb-deaf-47f3-abfc-f8b56425f103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1512469178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286111b4-358f-461b-bd50-c01832a7c531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73205a42f1fc48139b386fb334303d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:21Z,use_quota=True,user_id='47a8b5814215416084cbbbcfa6accb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd58b684-c4be-4fa3-aba4-1486e6d57da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd58b684-c4be-4fa3-aba4-1486e6d57da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7daf30f-61ce-4569-9eab-2efe123abed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7daf30f-61ce-4569-9eab-2efe123abed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '286111b4-358f-461b-bd50-c01832a7c531', 'volume_name': 'volume-286111b4-358f-461b-bd50-c01832a7c531', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82aad808-563f-42c2-bc5f-d1e6c351d6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82aad808-563f-42c2-bc5f-d1e6c351d6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399f6ff0-f8e8-493a-8bd3-bcbe07dd3a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:21 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Volume 286111b4-358f-461b-bd50-c01832a7c531: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-286111b4-358f-461b-bd50-c01832a7c531', 'volume_size': 1} Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:21 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fd05a478-55df-4594-b8e1-4099e3bcf73e tempest-SnapshotMetadataTestJSON-1081581944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.775c41f2-b234-44e0-832d-bba4da71edb0 1G" returned: 0 in 0.474s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fd05a478-55df-4594-b8e1-4099e3bcf73e tempest-SnapshotMetadataTestJSON-1081581944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9e6f59-c34b-4194-883e-d90c60cf173e -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.775c41f2-b234-44e0-832d-bba4da71edb0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:21 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9e6f59-c34b-4194-883e-d90c60cf173e -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.775c41f2-b234-44e0-832d-bba4da71edb0 Sep 07 13:58:21 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Flow 'volume_create_manager' (0167e80f-d282-4ad8-b693-dbae45fefe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37061cc0-7249-407b-a911-f5fa7b0ee328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37061cc0-7249-407b-a911-f5fa7b0ee328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-154634625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b63823-5253-4bb4-ba53-ed4e30a462c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73205a42f1fc48139b386fb334303d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:22Z,use_quota=True,user_id='47a8b5814215416084cbbbcfa6accb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe6d60a-8785-4f0d-83a9-70245036efe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe6d60a-8785-4f0d-83a9-70245036efe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ddc0d32-8478-482c-bd01-b1049d41d1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ddc0d32-8478-482c-bd01-b1049d41d1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62b63823-5253-4bb4-ba53-ed4e30a462c7', 'volume_name': 'volume-62b63823-5253-4bb4-ba53-ed4e30a462c7', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e76d9bc-6e73-4d69-884e-24c3518f0be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e76d9bc-6e73-4d69-884e-24c3518f0be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa5decb-b5ce-415a-9644-c883bddc2a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:21 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Volume 62b63823-5253-4bb4-ba53-ed4e30a462c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62b63823-5253-4bb4-ba53-ed4e30a462c7', 'volume_size': 1} Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:21 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fd05a478-55df-4594-b8e1-4099e3bcf73e tempest-SnapshotMetadataTestJSON-1081581944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9e6f59-c34b-4194-883e-d90c60cf173e -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.775c41f2-b234-44e0-832d-bba4da71edb0" returned: 0 in 0.319s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:21 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-fd05a478-55df-4594-b8e1-4099e3bcf73e tempest-SnapshotMetadataTestJSON-1081581944 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.775c41f2-b234-44e0-832d-bba4da71edb0 is being set with open permissions: ugo+rw Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fd05a478-55df-4594-b8e1-4099e3bcf73e tempest-SnapshotMetadataTestJSON-1081581944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.775c41f2-b234-44e0-832d-bba4da71edb0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:21 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.775c41f2-b234-44e0-832d-bba4da71edb0 Sep 07 13:58:21 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:21 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:58:22 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Flow 'volume_create_manager' (d8bb27ca-7767-49a8-911a-f42c8d87fe01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa5965c3-fa36-4fb8-aec1-b4ee6cce3ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fd05a478-55df-4594-b8e1-4099e3bcf73e tempest-SnapshotMetadataTestJSON-1081581944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.775c41f2-b234-44e0-832d-bba4da71edb0" returned: 0 in 0.327s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa5965c3-fa36-4fb8-aec1-b4ee6cce3ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1497925419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b1b002-39b8-429a-9086-5438fa9ab050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73205a42f1fc48139b386fb334303d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:22Z,use_quota=True,user_id='47a8b5814215416084cbbbcfa6accb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a423dd03-a638-4a0b-b50c-5b0c87006dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a423dd03-a638-4a0b-b50c-5b0c87006dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ce07a0-59cd-490c-a791-3d26daeea0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ce07a0-59cd-490c-a791-3d26daeea0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3b1b002-39b8-429a-9086-5438fa9ab050', 'volume_name': 'volume-b3b1b002-39b8-429a-9086-5438fa9ab050', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe786f4-c545-4045-84c1-07ab5a874a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe786f4-c545-4045-84c1-07ab5a874a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda358b6-fbeb-449b-85dc-782699036d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:22 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Volume b3b1b002-39b8-429a-9086-5438fa9ab050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3b1b002-39b8-429a-9086-5438fa9ab050', 'volume_size': 1} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fd05a478-55df-4594-b8e1-4099e3bcf73e tempest-SnapshotMetadataTestJSON-1081581944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:22 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.info Sep 07 13:58:22 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:58:22 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Flow 'volume_create_manager' (2a42f1e8-1ab6-44b7-a6c8-f4585d633237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe06b3a9-cb6c-48de-9c6c-a4fe8633e9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fd05a478-55df-4594-b8e1-4099e3bcf73e tempest-SnapshotMetadataTestJSON-1081581944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.info" returned: 0 in 0.295s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:22 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-fd05a478-55df-4594-b8e1-4099e3bcf73e tempest-SnapshotMetadataTestJSON-1081581944 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.info is being set with open permissions: ugo+rw Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fd05a478-55df-4594-b8e1-4099e3bcf73e tempest-SnapshotMetadataTestJSON-1081581944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe06b3a9-cb6c-48de-9c6c-a4fe8633e9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-863494095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ab9c32-10a5-441f-9ca8-abb9c4106def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73205a42f1fc48139b386fb334303d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:22Z,use_quota=True,user_id='47a8b5814215416084cbbbcfa6accb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:22 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.info Sep 07 13:58:22 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23bc9efd-ae4b-428e-85b3-96f0a09e62be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23bc9efd-ae4b-428e-85b3-96f0a09e62be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b067e6-adb8-455a-b88a-663de9c00a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b067e6-adb8-455a-b88a-663de9c00a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78ab9c32-10a5-441f-9ca8-abb9c4106def', 'volume_name': 'volume-78ab9c32-10a5-441f-9ca8-abb9c4106def', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64974207-9f8e-4b02-8cd3-287317c1ad24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64974207-9f8e-4b02-8cd3-287317c1ad24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381d9944-06bc-4c9b-90ec-5c638bd7ec1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:22 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Volume 78ab9c32-10a5-441f-9ca8-abb9c4106def: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78ab9c32-10a5-441f-9ca8-abb9c4106def', 'volume_size': 1} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:22 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fd05a478-55df-4594-b8e1-4099e3bcf73e tempest-SnapshotMetadataTestJSON-1081581944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.info" returned: 0 in 0.266s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fd05a478-55df-4594-b8e1-4099e3bcf73e tempest-SnapshotMetadataTestJSON-1081581944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.213s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.376s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1512469178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286111b4-358f-461b-bd50-c01832a7c531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73205a42f1fc48139b386fb334303d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:21Z,use_quota=True,user_id='47a8b5814215416084cbbbcfa6accb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Creating volume 286111b4-358f-461b-bd50-c01832a7c531 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:22 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-286111b4-358f-461b-bd50-c01832a7c531 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:22 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-286111b4-358f-461b-bd50-c01832a7c531 1073741824 Sep 07 13:58:22 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Flow 'volume_create_manager' (f30c6902-0038-43af-a03e-8f8697c4c3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c7ec171-a9b7-4dc3-bec2-ded16e74d68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:22 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-fd05a478-55df-4594-b8e1-4099e3bcf73e tempest-SnapshotMetadataTestJSON-1081581944 None] Create snapshot completed successfully Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c7ec171-a9b7-4dc3-bec2-ded16e74d68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-922027635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e2f371-878e-4a7d-be8a-9367d92797e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73205a42f1fc48139b386fb334303d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:23Z,use_quota=True,user_id='47a8b5814215416084cbbbcfa6accb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ddb907-ebd5-4578-8dfa-24295aaf8f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ddb907-ebd5-4578-8dfa-24295aaf8f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76038563-2e77-4626-8058-81105da7e07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76038563-2e77-4626-8058-81105da7e07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08e2f371-878e-4a7d-be8a-9367d92797e6', 'volume_name': 'volume-08e2f371-878e-4a7d-be8a-9367d92797e6', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a789ae-efb8-42cc-94da-51008d03e7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a789ae-efb8-42cc-94da-51008d03e7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daccab48-cee5-4479-8fcc-30f5bdf5ca47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:22 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Volume 08e2f371-878e-4a7d-be8a-9367d92797e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08e2f371-878e-4a7d-be8a-9367d92797e6', 'volume_size': 1} Sep 07 13:58:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:23 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-286111b4-358f-461b-bd50-c01832a7c531 1073741824" returned: 0 in 0.450s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-286111b4-358f-461b-bd50-c01832a7c531 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:23 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-286111b4-358f-461b-bd50-c01832a7c531 Sep 07 13:58:23 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:23 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-286111b4-358f-461b-bd50-c01832a7c531" returned: 0 in 0.256s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.802s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-154634625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b63823-5253-4bb4-ba53-ed4e30a462c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73205a42f1fc48139b386fb334303d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:22Z,use_quota=True,user_id='47a8b5814215416084cbbbcfa6accb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Creating volume 62b63823-5253-4bb4-ba53-ed4e30a462c7 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:23 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-62b63823-5253-4bb4-ba53-ed4e30a462c7 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399f6ff0-f8e8-493a-8bd3-bcbe07dd3a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-286111b4-358f-461b-bd50-c01832a7c531', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4657b55-972b-48d6-9b8f-4fc480ecfa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:23 devstack sudo[104646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-62b63823-5253-4bb4-ba53-ed4e30a462c7 1073741824 Sep 07 13:58:23 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:23 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Volume volume-286111b4-358f-461b-bd50-c01832a7c531 (286111b4-358f-461b-bd50-c01832a7c531): created successfully Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4657b55-972b-48d6-9b8f-4fc480ecfa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Flow 'volume_create_manager' (ce7d70d8-43ba-4283-b68b-cc9b129443c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:23 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-b43b5eec-880a-4069-b686-f352aa26d824 tempest-CreateVolumesFromSnapshotTest-487226501 None] Created volume successfully. Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-918772a2-0253-4662-a615-ef1c179dd81e tempest-SnapshotMetadataTestJSON-1081581944 None] Acquiring lock "cinder-775c41f2-b234-44e0-832d-bba4da71edb0-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-918772a2-0253-4662-a615-ef1c179dd81e tempest-SnapshotMetadataTestJSON-1081581944 None] Lock "cinder-775c41f2-b234-44e0-832d-bba4da71edb0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-918772a2-0253-4662-a615-ef1c179dd81e tempest-SnapshotMetadataTestJSON-1081581944 None] Acquiring lock "cinder-quobyte-cf9e6f59-c34b-4194-883e-d90c60cf173e" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-918772a2-0253-4662-a615-ef1c179dd81e tempest-SnapshotMetadataTestJSON-1081581944 None] Lock "cinder-quobyte-cf9e6f59-c34b-4194-883e-d90c60cf173e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-918772a2-0253-4662-a615-ef1c179dd81e tempest-SnapshotMetadataTestJSON-1081581944 None] Acquiring lock "cinder-quobyte-775c41f2-b234-44e0-832d-bba4da71edb0" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-918772a2-0253-4662-a615-ef1c179dd81e tempest-SnapshotMetadataTestJSON-1081581944 None] Lock "cinder-quobyte-775c41f2-b234-44e0-832d-bba4da71edb0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-918772a2-0253-4662-a615-ef1c179dd81e tempest-SnapshotMetadataTestJSON-1081581944 None] Deleting offline snapshot 775c41f2-b234-44e0-832d-bba4da71edb0 of volume cf9e6f59-c34b-4194-883e-d90c60cf173e {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-918772a2-0253-4662-a615-ef1c179dd81e tempest-SnapshotMetadataTestJSON-1081581944 None] snapshot_file for this snap is: volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.775c41f2-b234-44e0-832d-bba4da71edb0 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc177876-2d2a-4327-a39b-7dac9ded4f20]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-918772a2-0253-4662-a615-ef1c179dd81e tempest-SnapshotMetadataTestJSON-1081581944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.775c41f2-b234-44e0-832d-bba4da71edb0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:23 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.775c41f2-b234-44e0-832d-bba4da71edb0 Sep 07 13:58:23 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:23 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-62b63823-5253-4bb4-ba53-ed4e30a462c7 1073741824" returned: 0 in 0.471s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-62b63823-5253-4bb4-ba53-ed4e30a462c7 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:24 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-62b63823-5253-4bb4-ba53-ed4e30a462c7 Sep 07 13:58:24 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:24 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-918772a2-0253-4662-a615-ef1c179dd81e tempest-SnapshotMetadataTestJSON-1081581944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.775c41f2-b234-44e0-832d-bba4da71edb0" returned: 0 in 0.376s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-918772a2-0253-4662-a615-ef1c179dd81e tempest-SnapshotMetadataTestJSON-1081581944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf9e6f59-c34b-4194-883e-d90c60cf173e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03adf84-3441-44bc-a161-f0eb01ee7931]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-918772a2-0253-4662-a615-ef1c179dd81e tempest-SnapshotMetadataTestJSON-1081581944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:24 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-62b63823-5253-4bb4-ba53-ed4e30a462c7" returned: 0 in 0.244s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.150s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1497925419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b1b002-39b8-429a-9086-5438fa9ab050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73205a42f1fc48139b386fb334303d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:22Z,use_quota=True,user_id='47a8b5814215416084cbbbcfa6accb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Creating volume b3b1b002-39b8-429a-9086-5438fa9ab050 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:24 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b3b1b002-39b8-429a-9086-5438fa9ab050 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa5decb-b5ce-415a-9644-c883bddc2a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62b63823-5253-4bb4-ba53-ed4e30a462c7', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40137bf9-67ce-4b7b-b547-07a45fd4bd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:24 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b3b1b002-39b8-429a-9086-5438fa9ab050 1073741824 Sep 07 13:58:24 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:24 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Volume volume-62b63823-5253-4bb4-ba53-ed4e30a462c7 (62b63823-5253-4bb4-ba53-ed4e30a462c7): created successfully Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40137bf9-67ce-4b7b-b547-07a45fd4bd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:24 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e Sep 07 13:58:24 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Flow 'volume_create_manager' (0167e80f-d282-4ad8-b693-dbae45fefe41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:24 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-7c7b9ad3-8a70-4aad-8642-c20fbabb58ff tempest-CreateVolumesFromSnapshotTest-487226501 None] Created volume successfully. Sep 07 13:58:24 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-918772a2-0253-4662-a615-ef1c179dd81e tempest-SnapshotMetadataTestJSON-1081581944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e" returned: 0 in 0.357s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-918772a2-0253-4662-a615-ef1c179dd81e tempest-SnapshotMetadataTestJSON-1081581944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.775c41f2-b234-44e0-832d-bba4da71edb0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:24 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.775c41f2-b234-44e0-832d-bba4da71edb0 Sep 07 13:58:24 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:24 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b3b1b002-39b8-429a-9086-5438fa9ab050 1073741824" returned: 0 in 0.425s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b3b1b002-39b8-429a-9086-5438fa9ab050 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:24 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b3b1b002-39b8-429a-9086-5438fa9ab050 Sep 07 13:58:24 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:24 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-918772a2-0253-4662-a615-ef1c179dd81e tempest-SnapshotMetadataTestJSON-1081581944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.775c41f2-b234-44e0-832d-bba4da71edb0" returned: 0 in 0.400s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-918772a2-0253-4662-a615-ef1c179dd81e tempest-SnapshotMetadataTestJSON-1081581944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.775c41f2-b234-44e0-832d-bba4da71edb0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:24 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:24 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.775c41f2-b234-44e0-832d-bba4da71edb0 Sep 07 13:58:24 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b3b1b002-39b8-429a-9086-5438fa9ab050" returned: 0 in 0.260s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.502s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-863494095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ab9c32-10a5-441f-9ca8-abb9c4106def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73205a42f1fc48139b386fb334303d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:22Z,use_quota=True,user_id='47a8b5814215416084cbbbcfa6accb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Creating volume 78ab9c32-10a5-441f-9ca8-abb9c4106def {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:25 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-78ab9c32-10a5-441f-9ca8-abb9c4106def 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda358b6-fbeb-449b-85dc-782699036d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3b1b002-39b8-429a-9086-5438fa9ab050', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6fe06d-df8a-4d79-86bf-a085eb30c341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:25 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-78ab9c32-10a5-441f-9ca8-abb9c4106def 1073741824 Sep 07 13:58:25 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:25 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Volume volume-b3b1b002-39b8-429a-9086-5438fa9ab050 (b3b1b002-39b8-429a-9086-5438fa9ab050): created successfully Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6fe06d-df8a-4d79-86bf-a085eb30c341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Flow 'volume_create_manager' (d8bb27ca-7767-49a8-911a-f42c8d87fe01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:25 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-44c89a53-b35e-40a7-863c-f97812ac876f tempest-CreateVolumesFromSnapshotTest-487226501 None] Created volume successfully. Sep 07 13:58:25 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-918772a2-0253-4662-a615-ef1c179dd81e tempest-SnapshotMetadataTestJSON-1081581944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e.775c41f2-b234-44e0-832d-bba4da71edb0" returned: 0 in 0.250s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-918772a2-0253-4662-a615-ef1c179dd81e tempest-SnapshotMetadataTestJSON-1081581944 None] Lock "cinder-quobyte-775c41f2-b234-44e0-832d-bba4da71edb0" released by "_delete_snapshot" :: held 1.476s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-918772a2-0253-4662-a615-ef1c179dd81e tempest-SnapshotMetadataTestJSON-1081581944 None] Lock "cinder-quobyte-cf9e6f59-c34b-4194-883e-d90c60cf173e" released by "delete_snapshot" :: held 1.503s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-918772a2-0253-4662-a615-ef1c179dd81e tempest-SnapshotMetadataTestJSON-1081581944 None] Created reservations ['11a61b8c-985c-4873-8929-3da8b0e77966', '107c0604-e082-481d-8524-d5c2a36e6f04', 'bc8e8991-25b7-4344-bd81-3fa539002409', '3ecd00e8-6573-4ecb-9975-9a0291413c12'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:25 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-918772a2-0253-4662-a615-ef1c179dd81e tempest-SnapshotMetadataTestJSON-1081581944 None] Delete snapshot completed successfully. Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-918772a2-0253-4662-a615-ef1c179dd81e tempest-SnapshotMetadataTestJSON-1081581944 None] Lock "cinder-775c41f2-b234-44e0-832d-bba4da71edb0-delete_snapshot" released by "delete_snapshot" :: held 1.658s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:25 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-78ab9c32-10a5-441f-9ca8-abb9c4106def 1073741824" returned: 0 in 0.438s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-78ab9c32-10a5-441f-9ca8-abb9c4106def {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:25 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-78ab9c32-10a5-441f-9ca8-abb9c4106def Sep 07 13:58:25 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:25 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-78ab9c32-10a5-441f-9ca8-abb9c4106def" returned: 0 in 0.255s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.861s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-922027635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e2f371-878e-4a7d-be8a-9367d92797e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73205a42f1fc48139b386fb334303d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:23Z,use_quota=True,user_id='47a8b5814215416084cbbbcfa6accb21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Creating volume 08e2f371-878e-4a7d-be8a-9367d92797e6 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:25 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-08e2f371-878e-4a7d-be8a-9367d92797e6 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381d9944-06bc-4c9b-90ec-5c638bd7ec1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78ab9c32-10a5-441f-9ca8-abb9c4106def', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:25 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-08e2f371-878e-4a7d-be8a-9367d92797e6 1073741824 Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc64d67b-42f9-4fa6-b23d-be961e1143f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:25 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:25 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Volume volume-78ab9c32-10a5-441f-9ca8-abb9c4106def (78ab9c32-10a5-441f-9ca8-abb9c4106def): created successfully Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc64d67b-42f9-4fa6-b23d-be961e1143f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Flow 'volume_create_manager' (2a42f1e8-1ab6-44b7-a6c8-f4585d633237) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:25 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-b495a045-26a6-420a-8b9a-ee44eba8d1a5 tempest-CreateVolumesFromSnapshotTest-487226501 None] Created volume successfully. Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8b4c644b-c5e5-4a30-a781-830397b98b6f tempest-SnapshotMetadataTestJSON-1081581944 None] Acquiring lock "cinder-cf9e6f59-c34b-4194-883e-d90c60cf173e-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8b4c644b-c5e5-4a30-a781-830397b98b6f tempest-SnapshotMetadataTestJSON-1081581944 None] Lock "cinder-cf9e6f59-c34b-4194-883e-d90c60cf173e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8b4c644b-c5e5-4a30-a781-830397b98b6f tempest-SnapshotMetadataTestJSON-1081581944 None] Acquiring lock "cinder-quobyte-cf9e6f59-c34b-4194-883e-d90c60cf173e" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8b4c644b-c5e5-4a30-a781-830397b98b6f tempest-SnapshotMetadataTestJSON-1081581944 None] Lock "cinder-quobyte-cf9e6f59-c34b-4194-883e-d90c60cf173e" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6612a71-0be2-433f-9495-7252548a9858]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8b4c644b-c5e5-4a30-a781-830397b98b6f tempest-SnapshotMetadataTestJSON-1081581944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:26 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e Sep 07 13:58:26 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:26 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-08e2f371-878e-4a7d-be8a-9367d92797e6 1073741824" returned: 0 in 0.501s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-08e2f371-878e-4a7d-be8a-9367d92797e6 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:26 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-08e2f371-878e-4a7d-be8a-9367d92797e6 Sep 07 13:58:26 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:26 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8b4c644b-c5e5-4a30-a781-830397b98b6f tempest-SnapshotMetadataTestJSON-1081581944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e" returned: 0 in 0.373s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8b4c644b-c5e5-4a30-a781-830397b98b6f tempest-SnapshotMetadataTestJSON-1081581944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:26 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e Sep 07 13:58:26 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:26 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-08e2f371-878e-4a7d-be8a-9367d92797e6" returned: 0 in 0.249s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daccab48-cee5-4479-8fcc-30f5bdf5ca47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08e2f371-878e-4a7d-be8a-9367d92797e6', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92ecb6c-942f-4bde-b4b5-9104c89763fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:26 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Volume volume-08e2f371-878e-4a7d-be8a-9367d92797e6 (08e2f371-878e-4a7d-be8a-9367d92797e6): created successfully Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92ecb6c-942f-4bde-b4b5-9104c89763fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Flow 'volume_create_manager' (f30c6902-0038-43af-a03e-8f8697c4c3fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:26 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-ed9b57d3-57a5-4859-a484-6d049e363326 tempest-CreateVolumesFromSnapshotTest-487226501 None] Created volume successfully. Sep 07 13:58:26 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8b4c644b-c5e5-4a30-a781-830397b98b6f tempest-SnapshotMetadataTestJSON-1081581944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cf9e6f59-c34b-4194-883e-d90c60cf173e" returned: 0 in 0.261s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8b4c644b-c5e5-4a30-a781-830397b98b6f tempest-SnapshotMetadataTestJSON-1081581944 None] Lock "cinder-quobyte-cf9e6f59-c34b-4194-883e-d90c60cf173e" released by "delete_volume" :: held 0.691s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-8b4c644b-c5e5-4a30-a781-830397b98b6f tempest-SnapshotMetadataTestJSON-1081581944 None] Created reservations ['62a63779-2db6-47e1-8422-7648337cf238', 'a9fdc10c-e187-431a-b033-e357e30b6582', '500195b1-4a65-4148-b8bb-b66ca106b387', '13b3d240-29a4-4f87-b005-86ba56022a02'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8b4c644b-c5e5-4a30-a781-830397b98b6f tempest-SnapshotMetadataTestJSON-1081581944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8b4c644b-c5e5-4a30-a781-830397b98b6f tempest-SnapshotMetadataTestJSON-1081581944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8b4c644b-c5e5-4a30-a781-830397b98b6f tempest-SnapshotMetadataTestJSON-1081581944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8b4c644b-c5e5-4a30-a781-830397b98b6f tempest-SnapshotMetadataTestJSON-1081581944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8b4c644b-c5e5-4a30-a781-830397b98b6f tempest-SnapshotMetadataTestJSON-1081581944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8b4c644b-c5e5-4a30-a781-830397b98b6f tempest-SnapshotMetadataTestJSON-1081581944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:26 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:58:26 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:27 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8b4c644b-c5e5-4a30-a781-830397b98b6f tempest-SnapshotMetadataTestJSON-1081581944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.237s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:27 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-8b4c644b-c5e5-4a30-a781-830397b98b6f tempest-SnapshotMetadataTestJSON-1081581944 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:27 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-8b4c644b-c5e5-4a30-a781-830397b98b6f tempest-SnapshotMetadataTestJSON-1081581944 None] Deleted volume successfully. Sep 07 13:58:27 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8b4c644b-c5e5-4a30-a781-830397b98b6f tempest-SnapshotMetadataTestJSON-1081581944 None] Lock "cinder-cf9e6f59-c34b-4194-883e-d90c60cf173e-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:27 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f319b8de-d849-442f-96fb-b0ccfed44c3c tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "cinder-08e2f371-878e-4a7d-be8a-9367d92797e6-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:27 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f319b8de-d849-442f-96fb-b0ccfed44c3c tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-08e2f371-878e-4a7d-be8a-9367d92797e6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:27 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f319b8de-d849-442f-96fb-b0ccfed44c3c tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "cinder-quobyte-08e2f371-878e-4a7d-be8a-9367d92797e6" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:27 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f319b8de-d849-442f-96fb-b0ccfed44c3c tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-quobyte-08e2f371-878e-4a7d-be8a-9367d92797e6" acquired by "delete_volume" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:27 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9dc805-9a97-44d6-b6df-d3f72a90e8c2]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f319b8de-d849-442f-96fb-b0ccfed44c3c tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-08e2f371-878e-4a7d-be8a-9367d92797e6 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:27 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-08e2f371-878e-4a7d-be8a-9367d92797e6 Sep 07 13:58:27 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:27 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f319b8de-d849-442f-96fb-b0ccfed44c3c tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-08e2f371-878e-4a7d-be8a-9367d92797e6" returned: 0 in 0.375s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f319b8de-d849-442f-96fb-b0ccfed44c3c tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-08e2f371-878e-4a7d-be8a-9367d92797e6 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:27 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-08e2f371-878e-4a7d-be8a-9367d92797e6 Sep 07 13:58:27 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:27 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f319b8de-d849-442f-96fb-b0ccfed44c3c tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-08e2f371-878e-4a7d-be8a-9367d92797e6" returned: 0 in 0.248s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f319b8de-d849-442f-96fb-b0ccfed44c3c tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-quobyte-08e2f371-878e-4a7d-be8a-9367d92797e6" released by "delete_volume" :: held 0.665s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-f319b8de-d849-442f-96fb-b0ccfed44c3c tempest-CreateVolumesFromSnapshotTest-487226501 None] Created reservations ['ffc8466a-118c-476f-9529-116f9ed8e5b1', '0387132a-5309-4028-8f89-aa73e8b696d9', 'b3d777e9-e7d6-4e60-8f70-4474e765106b', '553eb179-bbeb-49e5-accf-d3d44238030b'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f319b8de-d849-442f-96fb-b0ccfed44c3c tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f319b8de-d849-442f-96fb-b0ccfed44c3c tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f319b8de-d849-442f-96fb-b0ccfed44c3c tempest-CreateVolumesFromSnapshotTest-487226501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f319b8de-d849-442f-96fb-b0ccfed44c3c tempest-CreateVolumesFromSnapshotTest-487226501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f319b8de-d849-442f-96fb-b0ccfed44c3c tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f319b8de-d849-442f-96fb-b0ccfed44c3c tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:28 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:58:28 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:28 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:58:28 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:28 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f319b8de-d849-442f-96fb-b0ccfed44c3c tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.276s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-f319b8de-d849-442f-96fb-b0ccfed44c3c tempest-CreateVolumesFromSnapshotTest-487226501 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:28 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-f319b8de-d849-442f-96fb-b0ccfed44c3c tempest-CreateVolumesFromSnapshotTest-487226501 None] Deleted volume successfully. Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0ebb4cd9-fe5b-4c03-96a2-12d3d7b2a57a tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "cinder-78ab9c32-10a5-441f-9ca8-abb9c4106def-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f319b8de-d849-442f-96fb-b0ccfed44c3c tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-08e2f371-878e-4a7d-be8a-9367d92797e6-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0ebb4cd9-fe5b-4c03-96a2-12d3d7b2a57a tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-78ab9c32-10a5-441f-9ca8-abb9c4106def-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0ebb4cd9-fe5b-4c03-96a2-12d3d7b2a57a tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "cinder-quobyte-78ab9c32-10a5-441f-9ca8-abb9c4106def" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0ebb4cd9-fe5b-4c03-96a2-12d3d7b2a57a tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-quobyte-78ab9c32-10a5-441f-9ca8-abb9c4106def" acquired by "delete_volume" :: waited 0.016s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab69c11-e51d-44a8-b999-35521b87f668]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0ebb4cd9-fe5b-4c03-96a2-12d3d7b2a57a tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-78ab9c32-10a5-441f-9ca8-abb9c4106def {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:28 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.363s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager._thread_info {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread count: 28 {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread info: [<_MainThread(MainThread, started 132147689414784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:58:28 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-78ab9c32-10a5-441f-9ca8-abb9c4106def Sep 07 13:58:28 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:28 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0ebb4cd9-fe5b-4c03-96a2-12d3d7b2a57a tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-78ab9c32-10a5-441f-9ca8-abb9c4106def" returned: 0 in 0.380s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0ebb4cd9-fe5b-4c03-96a2-12d3d7b2a57a tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-78ab9c32-10a5-441f-9ca8-abb9c4106def {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:29 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-78ab9c32-10a5-441f-9ca8-abb9c4106def Sep 07 13:58:29 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:29 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0ebb4cd9-fe5b-4c03-96a2-12d3d7b2a57a tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-78ab9c32-10a5-441f-9ca8-abb9c4106def" returned: 0 in 0.262s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0ebb4cd9-fe5b-4c03-96a2-12d3d7b2a57a tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-quobyte-78ab9c32-10a5-441f-9ca8-abb9c4106def" released by "delete_volume" :: held 0.691s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:29 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-0ebb4cd9-fe5b-4c03-96a2-12d3d7b2a57a tempest-CreateVolumesFromSnapshotTest-487226501 None] Created reservations ['c2ff9669-016a-41b4-b184-034dc97f948a', 'c7afae4a-8f5b-417a-b37d-91008eba9d02', '0092acf4-9f67-4b7f-b724-bd41326bb8ae', 'fb441fb6-8513-4644-b0bc-584bdff7c500'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0ebb4cd9-fe5b-4c03-96a2-12d3d7b2a57a tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0ebb4cd9-fe5b-4c03-96a2-12d3d7b2a57a tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0ebb4cd9-fe5b-4c03-96a2-12d3d7b2a57a tempest-CreateVolumesFromSnapshotTest-487226501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0ebb4cd9-fe5b-4c03-96a2-12d3d7b2a57a tempest-CreateVolumesFromSnapshotTest-487226501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0ebb4cd9-fe5b-4c03-96a2-12d3d7b2a57a tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0ebb4cd9-fe5b-4c03-96a2-12d3d7b2a57a tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:29 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:58:29 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-13f01fcc-99df-4703-9e02-639a8b7ad3c7 tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "cinder-b3b1b002-39b8-429a-9086-5438fa9ab050-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:29 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0ebb4cd9-fe5b-4c03-96a2-12d3d7b2a57a tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.271s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:29 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-0ebb4cd9-fe5b-4c03-96a2-12d3d7b2a57a tempest-CreateVolumesFromSnapshotTest-487226501 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-13f01fcc-99df-4703-9e02-639a8b7ad3c7 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-b3b1b002-39b8-429a-9086-5438fa9ab050-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:29 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-0ebb4cd9-fe5b-4c03-96a2-12d3d7b2a57a tempest-CreateVolumesFromSnapshotTest-487226501 None] Deleted volume successfully. Sep 07 13:58:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0ebb4cd9-fe5b-4c03-96a2-12d3d7b2a57a tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-78ab9c32-10a5-441f-9ca8-abb9c4106def-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-13f01fcc-99df-4703-9e02-639a8b7ad3c7 tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "cinder-quobyte-b3b1b002-39b8-429a-9086-5438fa9ab050" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-13f01fcc-99df-4703-9e02-639a8b7ad3c7 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-quobyte-b3b1b002-39b8-429a-9086-5438fa9ab050" acquired by "delete_volume" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:29 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2feeaa4-48cd-4d85-866d-95abdb3dcc94]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-13f01fcc-99df-4703-9e02-639a8b7ad3c7 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b3b1b002-39b8-429a-9086-5438fa9ab050 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:29 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b3b1b002-39b8-429a-9086-5438fa9ab050 Sep 07 13:58:29 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:30 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-13f01fcc-99df-4703-9e02-639a8b7ad3c7 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b3b1b002-39b8-429a-9086-5438fa9ab050" returned: 0 in 0.380s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-13f01fcc-99df-4703-9e02-639a8b7ad3c7 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b3b1b002-39b8-429a-9086-5438fa9ab050 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:30 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b3b1b002-39b8-429a-9086-5438fa9ab050 Sep 07 13:58:30 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:30 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-13f01fcc-99df-4703-9e02-639a8b7ad3c7 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b3b1b002-39b8-429a-9086-5438fa9ab050" returned: 0 in 0.272s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-13f01fcc-99df-4703-9e02-639a8b7ad3c7 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-quobyte-b3b1b002-39b8-429a-9086-5438fa9ab050" released by "delete_volume" :: held 0.691s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:30 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-13f01fcc-99df-4703-9e02-639a8b7ad3c7 tempest-CreateVolumesFromSnapshotTest-487226501 None] Created reservations ['6232f126-936c-4074-a750-f394d6c7c987', '9902b719-acd6-4ae6-b06f-3b4fc23632c6', '39f9f57f-5e6b-4d76-99e4-7c163b8b58df', '766effa0-42e7-4568-8499-b1cc3087196b'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-13f01fcc-99df-4703-9e02-639a8b7ad3c7 tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-13f01fcc-99df-4703-9e02-639a8b7ad3c7 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-13f01fcc-99df-4703-9e02-639a8b7ad3c7 tempest-CreateVolumesFromSnapshotTest-487226501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-13f01fcc-99df-4703-9e02-639a8b7ad3c7 tempest-CreateVolumesFromSnapshotTest-487226501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-13f01fcc-99df-4703-9e02-639a8b7ad3c7 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-13f01fcc-99df-4703-9e02-639a8b7ad3c7 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:30 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:58:30 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:30 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-13f01fcc-99df-4703-9e02-639a8b7ad3c7 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.252s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:30 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-13f01fcc-99df-4703-9e02-639a8b7ad3c7 tempest-CreateVolumesFromSnapshotTest-487226501 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:30 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-13f01fcc-99df-4703-9e02-639a8b7ad3c7 tempest-CreateVolumesFromSnapshotTest-487226501 None] Deleted volume successfully. Sep 07 13:58:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5a0c6159-6117-4af1-97e3-532c3ff802e4 tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "cinder-62b63823-5253-4bb4-ba53-ed4e30a462c7-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5a0c6159-6117-4af1-97e3-532c3ff802e4 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-62b63823-5253-4bb4-ba53-ed4e30a462c7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-13f01fcc-99df-4703-9e02-639a8b7ad3c7 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-b3b1b002-39b8-429a-9086-5438fa9ab050-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5a0c6159-6117-4af1-97e3-532c3ff802e4 tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "cinder-quobyte-62b63823-5253-4bb4-ba53-ed4e30a462c7" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5a0c6159-6117-4af1-97e3-532c3ff802e4 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-quobyte-62b63823-5253-4bb4-ba53-ed4e30a462c7" acquired by "delete_volume" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:30 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74d6b5b-e537-4045-9f5c-8c844044860d]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5a0c6159-6117-4af1-97e3-532c3ff802e4 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-62b63823-5253-4bb4-ba53-ed4e30a462c7 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:31 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-62b63823-5253-4bb4-ba53-ed4e30a462c7 Sep 07 13:58:31 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:31 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5a0c6159-6117-4af1-97e3-532c3ff802e4 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-62b63823-5253-4bb4-ba53-ed4e30a462c7" returned: 0 in 0.384s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5a0c6159-6117-4af1-97e3-532c3ff802e4 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-62b63823-5253-4bb4-ba53-ed4e30a462c7 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:31 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-62b63823-5253-4bb4-ba53-ed4e30a462c7 Sep 07 13:58:31 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:31 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5a0c6159-6117-4af1-97e3-532c3ff802e4 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-62b63823-5253-4bb4-ba53-ed4e30a462c7" returned: 0 in 0.253s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:31 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5a0c6159-6117-4af1-97e3-532c3ff802e4 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-quobyte-62b63823-5253-4bb4-ba53-ed4e30a462c7" released by "delete_volume" :: held 0.683s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:31 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-5a0c6159-6117-4af1-97e3-532c3ff802e4 tempest-CreateVolumesFromSnapshotTest-487226501 None] Created reservations ['89589086-1151-43c4-9ce2-ad253d4ec555', '75b19e63-c5f7-402f-8d2a-e4e8d825dd30', '14fba245-786d-43b9-b23a-4b527f81ab2c', '946dfb8d-75b3-4bf0-8fbb-9e53ec90e7c2'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5a0c6159-6117-4af1-97e3-532c3ff802e4 tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5a0c6159-6117-4af1-97e3-532c3ff802e4 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5a0c6159-6117-4af1-97e3-532c3ff802e4 tempest-CreateVolumesFromSnapshotTest-487226501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5a0c6159-6117-4af1-97e3-532c3ff802e4 tempest-CreateVolumesFromSnapshotTest-487226501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5a0c6159-6117-4af1-97e3-532c3ff802e4 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5a0c6159-6117-4af1-97e3-532c3ff802e4 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:31 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:58:31 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:32 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5a0c6159-6117-4af1-97e3-532c3ff802e4 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.251s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-5a0c6159-6117-4af1-97e3-532c3ff802e4 tempest-CreateVolumesFromSnapshotTest-487226501 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:32 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-5a0c6159-6117-4af1-97e3-532c3ff802e4 tempest-CreateVolumesFromSnapshotTest-487226501 None] Deleted volume successfully. Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5a0c6159-6117-4af1-97e3-532c3ff802e4 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-62b63823-5253-4bb4-ba53-ed4e30a462c7-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4c733217-f031-4e9a-9b04-8f07be2d845f tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "cinder-286111b4-358f-461b-bd50-c01832a7c531-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4c733217-f031-4e9a-9b04-8f07be2d845f tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-286111b4-358f-461b-bd50-c01832a7c531-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4c733217-f031-4e9a-9b04-8f07be2d845f tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "cinder-quobyte-286111b4-358f-461b-bd50-c01832a7c531" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4c733217-f031-4e9a-9b04-8f07be2d845f tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-quobyte-286111b4-358f-461b-bd50-c01832a7c531" acquired by "delete_volume" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e630bc-fff7-4e12-a107-ba2d22a54700]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4c733217-f031-4e9a-9b04-8f07be2d845f tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-286111b4-358f-461b-bd50-c01832a7c531 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:32 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-286111b4-358f-461b-bd50-c01832a7c531 Sep 07 13:58:32 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:32 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4c733217-f031-4e9a-9b04-8f07be2d845f tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-286111b4-358f-461b-bd50-c01832a7c531" returned: 0 in 0.393s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4c733217-f031-4e9a-9b04-8f07be2d845f tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-286111b4-358f-461b-bd50-c01832a7c531 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:32 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-286111b4-358f-461b-bd50-c01832a7c531 Sep 07 13:58:32 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Flow 'volume_create_manager' (20b5568f-8130-4c4c-92a0-a9022536c7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b48693a5-ff13-4e83-9190-3fab25872833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b48693a5-ff13-4e83-9190-3fab25872833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1507801842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12750fc3-9948-4837-92b7-5f8cabd48d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ecf82ed02ad4c959d3f03afdae8a0ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:33Z,use_quota=True,user_id='fdc350add53344649c43a0f13169b99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd635fcd-7d1e-4746-b292-41ef49a71627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd635fcd-7d1e-4746-b292-41ef49a71627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (703fe4f3-fcd8-415a-bcb1-51f91ecee6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (703fe4f3-fcd8-415a-bcb1-51f91ecee6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12750fc3-9948-4837-92b7-5f8cabd48d5d', 'volume_name': 'volume-12750fc3-9948-4837-92b7-5f8cabd48d5d', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a3baf5-cb7e-4974-b153-d350d8318e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a3baf5-cb7e-4974-b153-d350d8318e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99dee64-409e-4adc-8b4b-21eb6a53f917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:32 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Volume 12750fc3-9948-4837-92b7-5f8cabd48d5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12750fc3-9948-4837-92b7-5f8cabd48d5d', 'volume_size': 1} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1507801842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12750fc3-9948-4837-92b7-5f8cabd48d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ecf82ed02ad4c959d3f03afdae8a0ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:33Z,use_quota=True,user_id='fdc350add53344649c43a0f13169b99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Creating volume 12750fc3-9948-4837-92b7-5f8cabd48d5d {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:32 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-12750fc3-9948-4837-92b7-5f8cabd48d5d 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:32 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-12750fc3-9948-4837-92b7-5f8cabd48d5d 1073741824 Sep 07 13:58:32 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:32 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4c733217-f031-4e9a-9b04-8f07be2d845f tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-286111b4-358f-461b-bd50-c01832a7c531" returned: 0 in 0.278s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4c733217-f031-4e9a-9b04-8f07be2d845f tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-quobyte-286111b4-358f-461b-bd50-c01832a7c531" released by "delete_volume" :: held 0.711s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-4c733217-f031-4e9a-9b04-8f07be2d845f tempest-CreateVolumesFromSnapshotTest-487226501 None] Created reservations ['247bff13-0e69-42ec-9b09-fc27eb2d9c1c', '0e959acb-2ff9-45e6-bc62-fa27d05ff55c', 'd124b06c-b85a-4d10-b647-ce77dac076c0', '4d84cccf-79f9-41b4-9e8a-af1b485d5fde'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4c733217-f031-4e9a-9b04-8f07be2d845f tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4c733217-f031-4e9a-9b04-8f07be2d845f tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4c733217-f031-4e9a-9b04-8f07be2d845f tempest-CreateVolumesFromSnapshotTest-487226501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4c733217-f031-4e9a-9b04-8f07be2d845f tempest-CreateVolumesFromSnapshotTest-487226501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4c733217-f031-4e9a-9b04-8f07be2d845f tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4c733217-f031-4e9a-9b04-8f07be2d845f tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:33 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:58:33 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:33 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-12750fc3-9948-4837-92b7-5f8cabd48d5d 1073741824" returned: 0 in 0.474s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-12750fc3-9948-4837-92b7-5f8cabd48d5d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:33 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-42c31e89-babe-47cd-8739-f360ec04af93 tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "cinder-f6fcee42-7bba-46ac-b34e-fab0675c6128-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4c733217-f031-4e9a-9b04-8f07be2d845f tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.279s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:33 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-12750fc3-9948-4837-92b7-5f8cabd48d5d Sep 07 13:58:33 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-4c733217-f031-4e9a-9b04-8f07be2d845f tempest-CreateVolumesFromSnapshotTest-487226501 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:33 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-4c733217-f031-4e9a-9b04-8f07be2d845f tempest-CreateVolumesFromSnapshotTest-487226501 None] Deleted volume successfully. Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-42c31e89-babe-47cd-8739-f360ec04af93 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-f6fcee42-7bba-46ac-b34e-fab0675c6128-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-42c31e89-babe-47cd-8739-f360ec04af93 tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "cinder-quobyte-73531f87-f949-4685-8967-ed0709aa55b8" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-42c31e89-babe-47cd-8739-f360ec04af93 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-quobyte-73531f87-f949-4685-8967-ed0709aa55b8" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-42c31e89-babe-47cd-8739-f360ec04af93 tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "cinder-quobyte-f6fcee42-7bba-46ac-b34e-fab0675c6128" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4c733217-f031-4e9a-9b04-8f07be2d845f tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-286111b4-358f-461b-bd50-c01832a7c531-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-42c31e89-babe-47cd-8739-f360ec04af93 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-quobyte-f6fcee42-7bba-46ac-b34e-fab0675c6128" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-42c31e89-babe-47cd-8739-f360ec04af93 tempest-CreateVolumesFromSnapshotTest-487226501 None] Deleting offline snapshot f6fcee42-7bba-46ac-b34e-fab0675c6128 of volume 73531f87-f949-4685-8967-ed0709aa55b8 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-42c31e89-babe-47cd-8739-f360ec04af93 tempest-CreateVolumesFromSnapshotTest-487226501 None] snapshot_file for this snap is: volume-73531f87-f949-4685-8967-ed0709aa55b8.f6fcee42-7bba-46ac-b34e-fab0675c6128 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[95732fa4-f42a-46cc-9793-db9b32cbe472]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-42c31e89-babe-47cd-8739-f360ec04af93 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.f6fcee42-7bba-46ac-b34e-fab0675c6128 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:33 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.f6fcee42-7bba-46ac-b34e-fab0675c6128 Sep 07 13:58:33 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:33 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-12750fc3-9948-4837-92b7-5f8cabd48d5d" returned: 0 in 0.296s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99dee64-409e-4adc-8b4b-21eb6a53f917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12750fc3-9948-4837-92b7-5f8cabd48d5d', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (860f1826-05df-4d66-8f8d-cdc312b249e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:33 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Volume volume-12750fc3-9948-4837-92b7-5f8cabd48d5d (12750fc3-9948-4837-92b7-5f8cabd48d5d): created successfully Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (860f1826-05df-4d66-8f8d-cdc312b249e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Flow 'volume_create_manager' (20b5568f-8130-4c4c-92a0-a9022536c7ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:33 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-a28940ee-47a4-40b7-8c03-49ad627b0b9a tempest-VolumesTransfersTest-710829396 None] Created volume successfully. Sep 07 13:58:33 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-42c31e89-babe-47cd-8739-f360ec04af93 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.f6fcee42-7bba-46ac-b34e-fab0675c6128" returned: 0 in 0.373s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-42c31e89-babe-47cd-8739-f360ec04af93 tempest-CreateVolumesFromSnapshotTest-487226501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73531f87-f949-4685-8967-ed0709aa55b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd58a0b5-27f7-4e36-9e72-e415b63df41e]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-42c31e89-babe-47cd-8739-f360ec04af93 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:33 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8 Sep 07 13:58:33 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:34 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-42c31e89-babe-47cd-8739-f360ec04af93 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8" returned: 0 in 0.355s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-42c31e89-babe-47cd-8739-f360ec04af93 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.f6fcee42-7bba-46ac-b34e-fab0675c6128 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:34 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.f6fcee42-7bba-46ac-b34e-fab0675c6128 Sep 07 13:58:34 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:34 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-42c31e89-babe-47cd-8739-f360ec04af93 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.f6fcee42-7bba-46ac-b34e-fab0675c6128" returned: 0 in 0.337s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-42c31e89-babe-47cd-8739-f360ec04af93 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.f6fcee42-7bba-46ac-b34e-fab0675c6128 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:34 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.f6fcee42-7bba-46ac-b34e-fab0675c6128 Sep 07 13:58:34 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:34 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-42c31e89-babe-47cd-8739-f360ec04af93 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8.f6fcee42-7bba-46ac-b34e-fab0675c6128" returned: 0 in 0.269s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-42c31e89-babe-47cd-8739-f360ec04af93 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-quobyte-f6fcee42-7bba-46ac-b34e-fab0675c6128" released by "_delete_snapshot" :: held 1.437s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-42c31e89-babe-47cd-8739-f360ec04af93 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-quobyte-73531f87-f949-4685-8967-ed0709aa55b8" released by "delete_snapshot" :: held 1.461s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:34 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-42c31e89-babe-47cd-8739-f360ec04af93 tempest-CreateVolumesFromSnapshotTest-487226501 None] Created reservations ['4599f98f-1f13-4e25-b4db-ad9bae3ad3b9', '8ed102db-1d8a-4676-a8f5-5afc4607203c', '09cac78d-9af1-476a-a81e-d33edd9ed954', '00270532-09f1-4fba-8197-07dfbacc4a62'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:34 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-42c31e89-babe-47cd-8739-f360ec04af93 tempest-CreateVolumesFromSnapshotTest-487226501 None] Delete snapshot completed successfully. Sep 07 13:58:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-42c31e89-babe-47cd-8739-f360ec04af93 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-f6fcee42-7bba-46ac-b34e-fab0675c6128-delete_snapshot" released by "delete_snapshot" :: held 1.614s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:35 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c213caf6-0ec4-4ee7-90fe-55054a69eb42 tempest-VolumesTransfersTest-802401673 None] Transfer volume completed successfully. Sep 07 13:58:35 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2e89f418-23a5-44ad-a565-52e79c892da2 tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "cinder-73531f87-f949-4685-8967-ed0709aa55b8-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:35 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2e89f418-23a5-44ad-a565-52e79c892da2 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-73531f87-f949-4685-8967-ed0709aa55b8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:35 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2e89f418-23a5-44ad-a565-52e79c892da2 tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "cinder-quobyte-73531f87-f949-4685-8967-ed0709aa55b8" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:35 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2e89f418-23a5-44ad-a565-52e79c892da2 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-quobyte-73531f87-f949-4685-8967-ed0709aa55b8" acquired by "delete_volume" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:35 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[505a469d-3eaa-4cc3-9a5e-4be88fa23084]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2e89f418-23a5-44ad-a565-52e79c892da2 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:35 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8 Sep 07 13:58:35 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:35 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-28fa7c63-da02-4db0-ab13-c80d8db52624 tempest-VolumesTransfersTest-1529118499 None] Acquiring lock "cinder-12750fc3-9948-4837-92b7-5f8cabd48d5d-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:35 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-28fa7c63-da02-4db0-ab13-c80d8db52624 tempest-VolumesTransfersTest-1529118499 None] Lock "cinder-12750fc3-9948-4837-92b7-5f8cabd48d5d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:35 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-28fa7c63-da02-4db0-ab13-c80d8db52624 tempest-VolumesTransfersTest-1529118499 None] Acquiring lock "cinder-quobyte-12750fc3-9948-4837-92b7-5f8cabd48d5d" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:35 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-28fa7c63-da02-4db0-ab13-c80d8db52624 tempest-VolumesTransfersTest-1529118499 None] Lock "cinder-quobyte-12750fc3-9948-4837-92b7-5f8cabd48d5d" acquired by "delete_volume" :: waited 0.015s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:35 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2e89f418-23a5-44ad-a565-52e79c892da2 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8" returned: 0 in 0.433s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2e89f418-23a5-44ad-a565-52e79c892da2 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:35 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0985c365-d787-409c-9d2a-12b032e72709]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-28fa7c63-da02-4db0-ab13-c80d8db52624 tempest-VolumesTransfersTest-1529118499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-12750fc3-9948-4837-92b7-5f8cabd48d5d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:36 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8 Sep 07 13:58:36 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:36 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-12750fc3-9948-4837-92b7-5f8cabd48d5d Sep 07 13:58:36 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:36 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2e89f418-23a5-44ad-a565-52e79c892da2 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-73531f87-f949-4685-8967-ed0709aa55b8" returned: 0 in 0.257s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:36 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2e89f418-23a5-44ad-a565-52e79c892da2 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-quobyte-73531f87-f949-4685-8967-ed0709aa55b8" released by "delete_volume" :: held 0.744s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:36 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-2e89f418-23a5-44ad-a565-52e79c892da2 tempest-CreateVolumesFromSnapshotTest-487226501 None] Created reservations ['32760c2b-a266-4117-8cf6-a5146809f9e0', '24a6e862-fd1c-445f-8eb5-88f49969e6e5', '9b07c2b7-31bf-453c-a203-3398c6767a35', '06502c60-1a61-4aed-bb08-3568a7378520'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2e89f418-23a5-44ad-a565-52e79c892da2 tempest-CreateVolumesFromSnapshotTest-487226501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2e89f418-23a5-44ad-a565-52e79c892da2 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2e89f418-23a5-44ad-a565-52e79c892da2 tempest-CreateVolumesFromSnapshotTest-487226501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2e89f418-23a5-44ad-a565-52e79c892da2 tempest-CreateVolumesFromSnapshotTest-487226501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2e89f418-23a5-44ad-a565-52e79c892da2 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2e89f418-23a5-44ad-a565-52e79c892da2 tempest-CreateVolumesFromSnapshotTest-487226501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:36 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:58:36 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:36 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-28fa7c63-da02-4db0-ab13-c80d8db52624 tempest-VolumesTransfersTest-1529118499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-12750fc3-9948-4837-92b7-5f8cabd48d5d" returned: 0 in 0.439s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-28fa7c63-da02-4db0-ab13-c80d8db52624 tempest-VolumesTransfersTest-1529118499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-12750fc3-9948-4837-92b7-5f8cabd48d5d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:36 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-12750fc3-9948-4837-92b7-5f8cabd48d5d Sep 07 13:58:36 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:36 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2e89f418-23a5-44ad-a565-52e79c892da2 tempest-CreateVolumesFromSnapshotTest-487226501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.252s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:36 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-2e89f418-23a5-44ad-a565-52e79c892da2 tempest-CreateVolumesFromSnapshotTest-487226501 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:36 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-2e89f418-23a5-44ad-a565-52e79c892da2 tempest-CreateVolumesFromSnapshotTest-487226501 None] Deleted volume successfully. Sep 07 13:58:36 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2e89f418-23a5-44ad-a565-52e79c892da2 tempest-CreateVolumesFromSnapshotTest-487226501 None] Lock "cinder-73531f87-f949-4685-8967-ed0709aa55b8-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:36 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-28fa7c63-da02-4db0-ab13-c80d8db52624 tempest-VolumesTransfersTest-1529118499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-12750fc3-9948-4837-92b7-5f8cabd48d5d" returned: 0 in 0.263s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:36 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-28fa7c63-da02-4db0-ab13-c80d8db52624 tempest-VolumesTransfersTest-1529118499 None] Lock "cinder-quobyte-12750fc3-9948-4837-92b7-5f8cabd48d5d" released by "delete_volume" :: held 0.754s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:36 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-28fa7c63-da02-4db0-ab13-c80d8db52624 tempest-VolumesTransfersTest-1529118499 None] Created reservations ['23843700-fced-44e8-af9a-9fd482a02639', '2fe6eaca-97cd-4ded-beae-7a65f1b20951', '2f93ceb2-573d-4984-a60c-b8a304ec5f08', 'e1a2832a-7f30-4da1-826d-4b05055ed6bd'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-28fa7c63-da02-4db0-ab13-c80d8db52624 tempest-VolumesTransfersTest-1529118499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-28fa7c63-da02-4db0-ab13-c80d8db52624 tempest-VolumesTransfersTest-1529118499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-28fa7c63-da02-4db0-ab13-c80d8db52624 tempest-VolumesTransfersTest-1529118499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-28fa7c63-da02-4db0-ab13-c80d8db52624 tempest-VolumesTransfersTest-1529118499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-28fa7c63-da02-4db0-ab13-c80d8db52624 tempest-VolumesTransfersTest-1529118499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-28fa7c63-da02-4db0-ab13-c80d8db52624 tempest-VolumesTransfersTest-1529118499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:36 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:58:36 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:37 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-28fa7c63-da02-4db0-ab13-c80d8db52624 tempest-VolumesTransfersTest-1529118499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.281s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-28fa7c63-da02-4db0-ab13-c80d8db52624 tempest-VolumesTransfersTest-1529118499 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:37 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-28fa7c63-da02-4db0-ab13-c80d8db52624 tempest-VolumesTransfersTest-1529118499 None] Deleted volume successfully. Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-28fa7c63-da02-4db0-ab13-c80d8db52624 tempest-VolumesTransfersTest-1529118499 None] Lock "cinder-12750fc3-9948-4837-92b7-5f8cabd48d5d-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Flow 'volume_create_manager' (e646daa4-92b1-4f71-b3b9-c319e132ef29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8560e33c-7f10-4699-883b-40ac15dd380f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8560e33c-7f10-4699-883b-40ac15dd380f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-130149063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=500a0bc6-6dee-4978-8768-b4bc301d8985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ecf82ed02ad4c959d3f03afdae8a0ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:38Z,use_quota=True,user_id='fdc350add53344649c43a0f13169b99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a7f13b-f90e-40de-8b9a-be20c850d2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a7f13b-f90e-40de-8b9a-be20c850d2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09e3724-1b1a-4042-9445-f8102a412e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09e3724-1b1a-4042-9445-f8102a412e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '500a0bc6-6dee-4978-8768-b4bc301d8985', 'volume_name': 'volume-500a0bc6-6dee-4978-8768-b4bc301d8985', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e05d31-c7ed-4f2d-b329-24c878f4a066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e05d31-c7ed-4f2d-b329-24c878f4a066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac510bc7-becd-48dd-b9bc-c26061e8830d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:37 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Volume 500a0bc6-6dee-4978-8768-b4bc301d8985: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-500a0bc6-6dee-4978-8768-b4bc301d8985', 'volume_size': 1} Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-130149063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=500a0bc6-6dee-4978-8768-b4bc301d8985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ecf82ed02ad4c959d3f03afdae8a0ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:38Z,use_quota=True,user_id='fdc350add53344649c43a0f13169b99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Creating volume 500a0bc6-6dee-4978-8768-b4bc301d8985 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:37 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:58:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-500a0bc6-6dee-4978-8768-b4bc301d8985 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:37 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-500a0bc6-6dee-4978-8768-b4bc301d8985 1073741824 Sep 07 13:58:37 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:38 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-500a0bc6-6dee-4978-8768-b4bc301d8985 1073741824" returned: 0 in 0.461s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-500a0bc6-6dee-4978-8768-b4bc301d8985 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:38 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-500a0bc6-6dee-4978-8768-b4bc301d8985 Sep 07 13:58:38 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:38 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-500a0bc6-6dee-4978-8768-b4bc301d8985" returned: 0 in 0.260s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac510bc7-becd-48dd-b9bc-c26061e8830d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-500a0bc6-6dee-4978-8768-b4bc301d8985', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9248ff-7417-4794-aa9a-af7fc8e6ccd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:38 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Volume volume-500a0bc6-6dee-4978-8768-b4bc301d8985 (500a0bc6-6dee-4978-8768-b4bc301d8985): created successfully Sep 07 13:58:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9248ff-7417-4794-aa9a-af7fc8e6ccd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Flow 'volume_create_manager' (e646daa4-92b1-4f71-b3b9-c319e132ef29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:38 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-18ecbdd9-2a93-4f97-8457-ae664d850785 tempest-VolumesTransfersTest-710829396 None] Created volume successfully. Sep 07 13:58:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-522bad96-8131-4f29-858a-d485289c3d2e tempest-VolumesTransfersTest-1529118499 None] Acquiring lock "cinder-500a0bc6-6dee-4978-8768-b4bc301d8985-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-522bad96-8131-4f29-858a-d485289c3d2e tempest-VolumesTransfersTest-1529118499 None] Lock "cinder-500a0bc6-6dee-4978-8768-b4bc301d8985-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-522bad96-8131-4f29-858a-d485289c3d2e tempest-VolumesTransfersTest-1529118499 None] Acquiring lock "cinder-quobyte-500a0bc6-6dee-4978-8768-b4bc301d8985" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-522bad96-8131-4f29-858a-d485289c3d2e tempest-VolumesTransfersTest-1529118499 None] Lock "cinder-quobyte-500a0bc6-6dee-4978-8768-b4bc301d8985" acquired by "delete_volume" :: waited 0.016s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:38 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc82bb6-1cc1-439e-b20c-aad3488662ec]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-522bad96-8131-4f29-858a-d485289c3d2e tempest-VolumesTransfersTest-1529118499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-500a0bc6-6dee-4978-8768-b4bc301d8985 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:39 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-500a0bc6-6dee-4978-8768-b4bc301d8985 Sep 07 13:58:39 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:39 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-522bad96-8131-4f29-858a-d485289c3d2e tempest-VolumesTransfersTest-1529118499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-500a0bc6-6dee-4978-8768-b4bc301d8985" returned: 0 in 0.357s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-522bad96-8131-4f29-858a-d485289c3d2e tempest-VolumesTransfersTest-1529118499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-500a0bc6-6dee-4978-8768-b4bc301d8985 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:39 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-500a0bc6-6dee-4978-8768-b4bc301d8985 Sep 07 13:58:39 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:39 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-522bad96-8131-4f29-858a-d485289c3d2e tempest-VolumesTransfersTest-1529118499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-500a0bc6-6dee-4978-8768-b4bc301d8985" returned: 0 in 0.244s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-522bad96-8131-4f29-858a-d485289c3d2e tempest-VolumesTransfersTest-1529118499 None] Lock "cinder-quobyte-500a0bc6-6dee-4978-8768-b4bc301d8985" released by "delete_volume" :: held 0.639s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:39 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-522bad96-8131-4f29-858a-d485289c3d2e tempest-VolumesTransfersTest-1529118499 None] Created reservations ['9939bdd9-981a-4f01-be6e-06308493518c', 'e3b362e6-cb9e-4fa0-a4e9-c34027fb5da5', 'bafb0230-85b6-47db-ba62-6169935e0a45', 'd26ee1ed-3060-44ce-adb1-b0589a1ff75a'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-522bad96-8131-4f29-858a-d485289c3d2e tempest-VolumesTransfersTest-1529118499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-522bad96-8131-4f29-858a-d485289c3d2e tempest-VolumesTransfersTest-1529118499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-522bad96-8131-4f29-858a-d485289c3d2e tempest-VolumesTransfersTest-1529118499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-522bad96-8131-4f29-858a-d485289c3d2e tempest-VolumesTransfersTest-1529118499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-522bad96-8131-4f29-858a-d485289c3d2e tempest-VolumesTransfersTest-1529118499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-522bad96-8131-4f29-858a-d485289c3d2e tempest-VolumesTransfersTest-1529118499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:39 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:58:39 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:39 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-522bad96-8131-4f29-858a-d485289c3d2e tempest-VolumesTransfersTest-1529118499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.242s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:39 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-522bad96-8131-4f29-858a-d485289c3d2e tempest-VolumesTransfersTest-1529118499 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:39 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-522bad96-8131-4f29-858a-d485289c3d2e tempest-VolumesTransfersTest-1529118499 None] Deleted volume successfully. Sep 07 13:58:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-522bad96-8131-4f29-858a-d485289c3d2e tempest-VolumesTransfersTest-1529118499 None] Lock "cinder-500a0bc6-6dee-4978-8768-b4bc301d8985-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:42 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:58:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Flow 'volume_create_manager' (39c3cd56-98b8-4c0c-955e-bbc828f5932c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50049497-64c7-4cb2-a16c-767af4007507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50049497-64c7-4cb2-a16c-767af4007507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b891a708-6c99-4def-8f74-9acda37ab1d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be09609fd3d54e78bb01c8a547eb87b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:42Z,use_quota=True,user_id='5de7b6fdba4548e3857faa5fa2064939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0942d35c-7f96-4515-a1c4-d3053909553b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0942d35c-7f96-4515-a1c4-d3053909553b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1cdfe17-a281-45e8-8db0-1f78dd6c5274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:42 devstack cinder-volume[87571]: DEBUG cinder.image.glance [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Creating Keystone auth plugin from conf {{(pid=87571) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 13:58:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1cdfe17-a281-45e8-8db0-1f78dd6c5274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b891a708-6c99-4def-8f74-9acda37ab1d2', 'volume_name': 'volume-b891a708-6c99-4def-8f74-9acda37ab1d2', 'volume_size': 1, 'image_id': 'bdfd3007-38e8-42c2-8bc5-e792866900a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdfd3007-38e8-42c2-8bc5-e792866900a0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9d60de5025ece828244ac791bf453f9f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be09609fd3d54e78bb01c8a547eb87b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6cf39363a2d22f5805bf4c723b0ebae262a38fdea10c8de0ee8acde410083127f35117ab1e1c1a13dbc7fd71035cbe1c89897bc28ae8bf3404aeff9e2b308a12', 'id': 'bdfd3007-38e8-42c2-8bc5-e792866900a0', 'created_at': datetime.datetime(2026, 9, 7, 11, 58, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 58, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdfd3007-38e8-42c2-8bc5-e792866900a0/file', 'properties': {}}, 'image_service': }' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93dfa421-0578-4789-9962-5dd79587c001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93dfa421-0578-4789-9962-5dd79587c001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea545c35-f1a9-4eb7-a3a3-057387366921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:42 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Volume b891a708-6c99-4def-8f74-9acda37ab1d2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b891a708-6c99-4def-8f74-9acda37ab1d2', 'volume_size': 1, 'image_id': 'bdfd3007-38e8-42c2-8bc5-e792866900a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdfd3007-38e8-42c2-8bc5-e792866900a0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9d60de5025ece828244ac791bf453f9f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be09609fd3d54e78bb01c8a547eb87b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6cf39363a2d22f5805bf4c723b0ebae262a38fdea10c8de0ee8acde410083127f35117ab1e1c1a13dbc7fd71035cbe1c89897bc28ae8bf3404aeff9e2b308a12', 'id': 'bdfd3007-38e8-42c2-8bc5-e792866900a0', 'created_at': datetime.datetime(2026, 9, 7, 11, 58, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 58, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdfd3007-38e8-42c2-8bc5-e792866900a0/file', 'properties': {}}, 'image_service': } Sep 07 13:58:42 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Trying to clone b891a708-6c99-4def-8f74-9acda37ab1d2 from image bdfd3007-38e8-42c2-8bc5-e792866900a0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bdfd3007-38e8-42c2-8bc5-e792866900a0', 'metadata': {}}]). {{(pid=87571) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1099}} Sep 07 13:58:42 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 13:58:42 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Image download 0.00 MB at 0.00 MB/s Sep 07 13:58:43 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d6cd00-13d3-4d48-a98e-a29cf27a8f23]: (4, 'raw') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:43 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD Sep 07 13:58:43 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:43 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:43 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD Sep 07 13:58:43 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:43 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD" returned: 1 in 0.322s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 13:58:43 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Temporary image bdfd3007-38e8-42c2-8bc5-e792866900a0 is fetched for user 5de7b6fdba4548e3857faa5fa2064939. {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 13:58:43 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5932e7c5-937e-4088-90ff-20472f1dbcc3]: (4, 'raw') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:43 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD Sep 07 13:58:43 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:44 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:44 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD Sep 07 13:58:44 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:44 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD" returned: 1 in 0.330s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 13:58:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b891a708-6c99-4def-8f74-9acda37ab1d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be09609fd3d54e78bb01c8a547eb87b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:42Z,use_quota=True,user_id='5de7b6fdba4548e3857faa5fa2064939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Creating volume b891a708-6c99-4def-8f74-9acda37ab1d2 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:44 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:58:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b891a708-6c99-4def-8f74-9acda37ab1d2 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:44 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b891a708-6c99-4def-8f74-9acda37ab1d2 1073741824 Sep 07 13:58:44 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:44 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b891a708-6c99-4def-8f74-9acda37ab1d2 1073741824" returned: 0 in 0.416s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b891a708-6c99-4def-8f74-9acda37ab1d2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:44 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b891a708-6c99-4def-8f74-9acda37ab1d2 Sep 07 13:58:44 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:45 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b891a708-6c99-4def-8f74-9acda37ab1d2" returned: 0 in 0.284s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:45 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:45 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Attempting download of bdfd3007-38e8-42c2-8bc5-e792866900a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/bdfd3007-38e8-42c2-8bc5-e792866900a0', 'metadata': {}}])) to volume b891a708-6c99-4def-8f74-9acda37ab1d2. {{(pid=87571) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 13:58:45 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ec2687-450e-4bd3-901d-3d1dc3dedd5d]: (4, 'raw') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdfd3007-38e8-42c2-8bc5-e792866900a0_jb0_wpfg {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:45 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdfd3007-38e8-42c2-8bc5-e792866900a0_jb0_wpfg Sep 07 13:58:45 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:45 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdfd3007-38e8-42c2-8bc5-e792866900a0_jb0_wpfg" returned: 0 in 0.355s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdfd3007-38e8-42c2-8bc5-e792866900a0_jb0_wpfg {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:45 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdfd3007-38e8-42c2-8bc5-e792866900a0_jb0_wpfg Sep 07 13:58:45 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:46 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdfd3007-38e8-42c2-8bc5-e792866900a0_jb0_wpfg" returned: 1 in 0.351s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdfd3007-38e8-42c2-8bc5-e792866900a0_jb0_wpfg' failed. Not Retrying. {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 13:58:46 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcf847b-1a8f-4468-be0b-f7e2026e0a5a]: (4, 'raw') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:46 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD Sep 07 13:58:46 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:46 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:46 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD Sep 07 13:58:46 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:46 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD" returned: 1 in 0.363s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 13:58:46 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] bdfd3007-38e8-42c2-8bc5-e792866900a0 was raw, converting to qcow2 {{(pid=87571) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 13:58:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b891a708-6c99-4def-8f74-9acda37ab1d2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:46 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b891a708-6c99-4def-8f74-9acda37ab1d2 Sep 07 13:58:46 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:47 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b891a708-6c99-4def-8f74-9acda37ab1d2" returned: 0 in 0.467s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bdfd3007-38e8-42c2-8bc5-e792866900a0_fgwwutyqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b891a708-6c99-4def-8f74-9acda37ab1d2 {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:58:47 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b891a708-6c99-4def-8f74-9acda37ab1d2 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:47 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b891a708-6c99-4def-8f74-9acda37ab1d2 1G Sep 07 13:58:47 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:47 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b891a708-6c99-4def-8f74-9acda37ab1d2 1G" returned: 0 in 0.318s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Downloaded image bdfd3007-38e8-42c2-8bc5-e792866900a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/bdfd3007-38e8-42c2-8bc5-e792866900a0', 'metadata': {}}])) to volume b891a708-6c99-4def-8f74-9acda37ab1d2 successfully. {{(pid=87571) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Temporary image bdfd3007-38e8-42c2-8bc5-e792866900a0 for user 5de7b6fdba4548e3857faa5fa2064939 is deleted. {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Marking volume b891a708-6c99-4def-8f74-9acda37ab1d2 as bootable. {{(pid=87571) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=136,cinder:UPDATE=176,cinder:INSERT=37,cinder:DELETE=15 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Copying metadata from image bdfd3007-38e8-42c2-8bc5-e792866900a0 to b891a708-6c99-4def-8f74-9acda37ab1d2. {{(pid=87571) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Creating volume glance metadata for volume b891a708-6c99-4def-8f74-9acda37ab1d2 backed by image bdfd3007-38e8-42c2-8bc5-e792866900a0 with: {'image_id': 'bdfd3007-38e8-42c2-8bc5-e792866900a0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9d60de5025ece828244ac791bf453f9f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87571) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:UPDATE=190,cinder:SELECT=134,cinder:INSERT=52,cinder:DELETE=15 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea545c35-f1a9-4eb7-a3a3-057387366921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b891a708-6c99-4def-8f74-9acda37ab1d2', 'volume_size': 1, 'image_id': 'bdfd3007-38e8-42c2-8bc5-e792866900a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdfd3007-38e8-42c2-8bc5-e792866900a0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9d60de5025ece828244ac791bf453f9f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be09609fd3d54e78bb01c8a547eb87b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6cf39363a2d22f5805bf4c723b0ebae262a38fdea10c8de0ee8acde410083127f35117ab1e1c1a13dbc7fd71035cbe1c89897bc28ae8bf3404aeff9e2b308a12', 'id': 'bdfd3007-38e8-42c2-8bc5-e792866900a0', 'created_at': datetime.datetime(2026, 9, 7, 11, 58, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 58, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdfd3007-38e8-42c2-8bc5-e792866900a0/file', 'properties': {}}, 'image_service': }' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b8ab5f-917a-4ad4-92ec-221281a49079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:47 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Volume volume-b891a708-6c99-4def-8f74-9acda37ab1d2 (b891a708-6c99-4def-8f74-9acda37ab1d2): created successfully Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b8ab5f-917a-4ad4-92ec-221281a49079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Flow 'volume_create_manager' (39c3cd56-98b8-4c0c-955e-bbc828f5932c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:47 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-6e57dfa0-59b1-4e72-9c25-4f64e4088dda tempest-VolumeImageDependencyTests-1095372094 None] Created volume successfully. Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Flow 'volume_create_manager' (79bcb741-3849-46e4-9a81-690a7f222df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dde3a03-c921-41a5-acc1-b726ee57d254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dde3a03-c921-41a5-acc1-b726ee57d254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-222534729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5eabcc7-50b9-47bb-ba7d-0572f860dd8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f7c2ce98b84ef7bc6666c1148ecb0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:48Z,use_quota=True,user_id='efcb856afaf64c318afecec6fcb4e14e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4867519-e61a-4ae4-963d-ce785a001c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4867519-e61a-4ae4-963d-ce785a001c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a265226-4025-4670-b50d-e81c43891ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a265226-4025-4670-b50d-e81c43891ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5eabcc7-50b9-47bb-ba7d-0572f860dd8b', 'volume_name': 'volume-d5eabcc7-50b9-47bb-ba7d-0572f860dd8b', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66d1b86-8fd3-447d-afa4-d39381c81397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66d1b86-8fd3-447d-afa4-d39381c81397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dccbf7cc-12f9-4678-853d-d56ddd879738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:47 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Volume d5eabcc7-50b9-47bb-ba7d-0572f860dd8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5eabcc7-50b9-47bb-ba7d-0572f860dd8b', 'volume_size': 1} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-222534729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5eabcc7-50b9-47bb-ba7d-0572f860dd8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f7c2ce98b84ef7bc6666c1148ecb0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:48Z,use_quota=True,user_id='efcb856afaf64c318afecec6fcb4e14e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Creating volume d5eabcc7-50b9-47bb-ba7d-0572f860dd8b {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:47 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:58:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5eabcc7-50b9-47bb-ba7d-0572f860dd8b 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:47 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5eabcc7-50b9-47bb-ba7d-0572f860dd8b 1073741824 Sep 07 13:58:47 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:48 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5eabcc7-50b9-47bb-ba7d-0572f860dd8b 1073741824" returned: 0 in 0.443s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5eabcc7-50b9-47bb-ba7d-0572f860dd8b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:48 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5eabcc7-50b9-47bb-ba7d-0572f860dd8b Sep 07 13:58:48 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:48 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5eabcc7-50b9-47bb-ba7d-0572f860dd8b" returned: 0 in 0.245s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dccbf7cc-12f9-4678-853d-d56ddd879738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5eabcc7-50b9-47bb-ba7d-0572f860dd8b', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eefeeb73-7794-41d9-a5f0-288c285b90a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:48 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Volume volume-d5eabcc7-50b9-47bb-ba7d-0572f860dd8b (d5eabcc7-50b9-47bb-ba7d-0572f860dd8b): created successfully Sep 07 13:58:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eefeeb73-7794-41d9-a5f0-288c285b90a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Flow 'volume_create_manager' (79bcb741-3849-46e4-9a81-690a7f222df6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:48 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-a204eede-2e85-4d86-b575-02acd07f9005 tempest-VolumesTransfersV355Test-1159594043 None] Created volume successfully. Sep 07 13:58:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f5783df6-f22e-41aa-9cb6-83928f4642de tempest-VolumeImageDependencyTests-1095372094 None] Acquiring lock "cinder-b891a708-6c99-4def-8f74-9acda37ab1d2-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f5783df6-f22e-41aa-9cb6-83928f4642de tempest-VolumeImageDependencyTests-1095372094 None] Lock "cinder-b891a708-6c99-4def-8f74-9acda37ab1d2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f5783df6-f22e-41aa-9cb6-83928f4642de tempest-VolumeImageDependencyTests-1095372094 None] Acquiring lock "cinder-quobyte-b891a708-6c99-4def-8f74-9acda37ab1d2" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f5783df6-f22e-41aa-9cb6-83928f4642de tempest-VolumeImageDependencyTests-1095372094 None] Lock "cinder-quobyte-b891a708-6c99-4def-8f74-9acda37ab1d2" acquired by "delete_volume" :: waited 0.014s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:48 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c903f0d-c44f-4655-b5b7-848365662658]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f5783df6-f22e-41aa-9cb6-83928f4642de tempest-VolumeImageDependencyTests-1095372094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b891a708-6c99-4def-8f74-9acda37ab1d2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:49 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b891a708-6c99-4def-8f74-9acda37ab1d2 Sep 07 13:58:49 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:49 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f5783df6-f22e-41aa-9cb6-83928f4642de tempest-VolumeImageDependencyTests-1095372094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b891a708-6c99-4def-8f74-9acda37ab1d2" returned: 0 in 0.380s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f5783df6-f22e-41aa-9cb6-83928f4642de tempest-VolumeImageDependencyTests-1095372094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b891a708-6c99-4def-8f74-9acda37ab1d2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:49 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b891a708-6c99-4def-8f74-9acda37ab1d2 Sep 07 13:58:49 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:49 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-cd94a27d-4047-4425-a2a5-6efefc47e0e7 tempest-VolumesTransfersV355Test-1227468926 None] Transfer volume completed successfully. Sep 07 13:58:49 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f5783df6-f22e-41aa-9cb6-83928f4642de tempest-VolumeImageDependencyTests-1095372094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b891a708-6c99-4def-8f74-9acda37ab1d2" returned: 0 in 0.277s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:49 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f5783df6-f22e-41aa-9cb6-83928f4642de tempest-VolumeImageDependencyTests-1095372094 None] Lock "cinder-quobyte-b891a708-6c99-4def-8f74-9acda37ab1d2" released by "delete_volume" :: held 0.706s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:49 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-f5783df6-f22e-41aa-9cb6-83928f4642de tempest-VolumeImageDependencyTests-1095372094 None] Created reservations ['ca32adfd-7204-4c40-bfa2-0e9d78b05c55', '74fa393a-b50e-4214-a314-e4e69631d4b1', '1fc80e0e-cc70-4152-bc5f-8593d76ded46', 'f21209be-30d7-469d-9ff3-513c8c82ab67'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f5783df6-f22e-41aa-9cb6-83928f4642de tempest-VolumeImageDependencyTests-1095372094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f5783df6-f22e-41aa-9cb6-83928f4642de tempest-VolumeImageDependencyTests-1095372094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:49 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f5783df6-f22e-41aa-9cb6-83928f4642de tempest-VolumeImageDependencyTests-1095372094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:49 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f5783df6-f22e-41aa-9cb6-83928f4642de tempest-VolumeImageDependencyTests-1095372094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f5783df6-f22e-41aa-9cb6-83928f4642de tempest-VolumeImageDependencyTests-1095372094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f5783df6-f22e-41aa-9cb6-83928f4642de tempest-VolumeImageDependencyTests-1095372094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:49 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:58:49 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:49 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:49 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e10dea6b-c223-4d00-906d-d0e27111e579 tempest-VolumesTransfersV355Test-1825826473 None] Acquiring lock "cinder-d5eabcc7-50b9-47bb-ba7d-0572f860dd8b-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f5783df6-f22e-41aa-9cb6-83928f4642de tempest-VolumeImageDependencyTests-1095372094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.282s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:50 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-f5783df6-f22e-41aa-9cb6-83928f4642de tempest-VolumeImageDependencyTests-1095372094 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:50 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-f5783df6-f22e-41aa-9cb6-83928f4642de tempest-VolumeImageDependencyTests-1095372094 None] Deleted volume successfully. Sep 07 13:58:50 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e10dea6b-c223-4d00-906d-d0e27111e579 tempest-VolumesTransfersV355Test-1825826473 None] Lock "cinder-d5eabcc7-50b9-47bb-ba7d-0572f860dd8b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:50 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f5783df6-f22e-41aa-9cb6-83928f4642de tempest-VolumeImageDependencyTests-1095372094 None] Lock "cinder-b891a708-6c99-4def-8f74-9acda37ab1d2-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:50 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e10dea6b-c223-4d00-906d-d0e27111e579 tempest-VolumesTransfersV355Test-1825826473 None] Acquiring lock "cinder-quobyte-d5eabcc7-50b9-47bb-ba7d-0572f860dd8b" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:50 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e10dea6b-c223-4d00-906d-d0e27111e579 tempest-VolumesTransfersV355Test-1825826473 None] Lock "cinder-quobyte-d5eabcc7-50b9-47bb-ba7d-0572f860dd8b" acquired by "delete_volume" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:50 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab4c85a-f13c-41a8-a46b-d5c6ff7d0329]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e10dea6b-c223-4d00-906d-d0e27111e579 tempest-VolumesTransfersV355Test-1825826473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5eabcc7-50b9-47bb-ba7d-0572f860dd8b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:50 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5eabcc7-50b9-47bb-ba7d-0572f860dd8b Sep 07 13:58:50 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:50 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e10dea6b-c223-4d00-906d-d0e27111e579 tempest-VolumesTransfersV355Test-1825826473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5eabcc7-50b9-47bb-ba7d-0572f860dd8b" returned: 0 in 0.361s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e10dea6b-c223-4d00-906d-d0e27111e579 tempest-VolumesTransfersV355Test-1825826473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5eabcc7-50b9-47bb-ba7d-0572f860dd8b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:50 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5eabcc7-50b9-47bb-ba7d-0572f860dd8b Sep 07 13:58:50 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:50 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e10dea6b-c223-4d00-906d-d0e27111e579 tempest-VolumesTransfersV355Test-1825826473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5eabcc7-50b9-47bb-ba7d-0572f860dd8b" returned: 0 in 0.275s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:50 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e10dea6b-c223-4d00-906d-d0e27111e579 tempest-VolumesTransfersV355Test-1825826473 None] Lock "cinder-quobyte-d5eabcc7-50b9-47bb-ba7d-0572f860dd8b" released by "delete_volume" :: held 0.685s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:50 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-e10dea6b-c223-4d00-906d-d0e27111e579 tempest-VolumesTransfersV355Test-1825826473 None] Created reservations ['7367063a-c0ec-499f-875d-247530bed19a', '09339d0d-de6a-455c-a4e4-280f622ed45f', '4014e819-8ff2-435d-be1f-ab1baadcb275', 'b535ef5a-f523-4d84-95eb-5b2786fda2fb'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e10dea6b-c223-4d00-906d-d0e27111e579 tempest-VolumesTransfersV355Test-1825826473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e10dea6b-c223-4d00-906d-d0e27111e579 tempest-VolumesTransfersV355Test-1825826473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:50 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e10dea6b-c223-4d00-906d-d0e27111e579 tempest-VolumesTransfersV355Test-1825826473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:50 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e10dea6b-c223-4d00-906d-d0e27111e579 tempest-VolumesTransfersV355Test-1825826473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e10dea6b-c223-4d00-906d-d0e27111e579 tempest-VolumesTransfersV355Test-1825826473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e10dea6b-c223-4d00-906d-d0e27111e579 tempest-VolumesTransfersV355Test-1825826473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:50 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:58:50 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:51 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e10dea6b-c223-4d00-906d-d0e27111e579 tempest-VolumesTransfersV355Test-1825826473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.289s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-e10dea6b-c223-4d00-906d-d0e27111e579 tempest-VolumesTransfersV355Test-1825826473 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:51 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-e10dea6b-c223-4d00-906d-d0e27111e579 tempest-VolumesTransfersV355Test-1825826473 None] Deleted volume successfully. Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e10dea6b-c223-4d00-906d-d0e27111e579 tempest-VolumesTransfersV355Test-1825826473 None] Lock "cinder-d5eabcc7-50b9-47bb-ba7d-0572f860dd8b-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Flow 'volume_create_manager' (a4947c6e-8b9d-48aa-a649-2003340d8d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86f063a-7c0d-4389-a20f-a67effc5735c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86f063a-7c0d-4389-a20f-a67effc5735c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-118637973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f050e9e7-5a36-4a41-ab29-0d31d51a3da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f7c2ce98b84ef7bc6666c1148ecb0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:52Z,use_quota=True,user_id='efcb856afaf64c318afecec6fcb4e14e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd99a84-79a7-4ac5-bb79-d76a87f2e638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd99a84-79a7-4ac5-bb79-d76a87f2e638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c36834-1a5e-4134-b7d5-dcc51508bd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c36834-1a5e-4134-b7d5-dcc51508bd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f050e9e7-5a36-4a41-ab29-0d31d51a3da7', 'volume_name': 'volume-f050e9e7-5a36-4a41-ab29-0d31d51a3da7', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0946a2b6-6ea3-4427-8199-4a3d8a2aaa50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0946a2b6-6ea3-4427-8199-4a3d8a2aaa50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d4e68aa-2fb1-4846-b13d-aeb554e25639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:51 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Volume f050e9e7-5a36-4a41-ab29-0d31d51a3da7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f050e9e7-5a36-4a41-ab29-0d31d51a3da7', 'volume_size': 1} Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-118637973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f050e9e7-5a36-4a41-ab29-0d31d51a3da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f7c2ce98b84ef7bc6666c1148ecb0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:52Z,use_quota=True,user_id='efcb856afaf64c318afecec6fcb4e14e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Creating volume f050e9e7-5a36-4a41-ab29-0d31d51a3da7 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:51 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:58:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f050e9e7-5a36-4a41-ab29-0d31d51a3da7 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:51 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f050e9e7-5a36-4a41-ab29-0d31d51a3da7 1073741824 Sep 07 13:58:51 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:52 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f050e9e7-5a36-4a41-ab29-0d31d51a3da7 1073741824" returned: 0 in 0.424s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f050e9e7-5a36-4a41-ab29-0d31d51a3da7 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:52 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f050e9e7-5a36-4a41-ab29-0d31d51a3da7 Sep 07 13:58:52 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:52 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f050e9e7-5a36-4a41-ab29-0d31d51a3da7" returned: 0 in 0.245s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:52 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:52 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d4e68aa-2fb1-4846-b13d-aeb554e25639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f050e9e7-5a36-4a41-ab29-0d31d51a3da7', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:52 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfba03fa-320b-41ce-8585-749e15b554e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:52 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Volume volume-f050e9e7-5a36-4a41-ab29-0d31d51a3da7 (f050e9e7-5a36-4a41-ab29-0d31d51a3da7): created successfully Sep 07 13:58:52 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfba03fa-320b-41ce-8585-749e15b554e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:52 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Flow 'volume_create_manager' (a4947c6e-8b9d-48aa-a649-2003340d8d5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:52 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-75675ed3-56a5-430b-a607-c8c84fac1ab9 tempest-VolumesTransfersV355Test-1159594043 None] Created volume successfully. Sep 07 13:58:53 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e02a40a0-ae5d-4361-b962-868e916327b4 tempest-VolumesTransfersV355Test-1825826473 None] Acquiring lock "cinder-f050e9e7-5a36-4a41-ab29-0d31d51a3da7-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:53 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e02a40a0-ae5d-4361-b962-868e916327b4 tempest-VolumesTransfersV355Test-1825826473 None] Lock "cinder-f050e9e7-5a36-4a41-ab29-0d31d51a3da7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:53 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e02a40a0-ae5d-4361-b962-868e916327b4 tempest-VolumesTransfersV355Test-1825826473 None] Acquiring lock "cinder-quobyte-f050e9e7-5a36-4a41-ab29-0d31d51a3da7" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:53 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e02a40a0-ae5d-4361-b962-868e916327b4 tempest-VolumesTransfersV355Test-1825826473 None] Lock "cinder-quobyte-f050e9e7-5a36-4a41-ab29-0d31d51a3da7" acquired by "delete_volume" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:53 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3292c12-5093-471f-a4d4-79c54dcdf2f9]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e02a40a0-ae5d-4361-b962-868e916327b4 tempest-VolumesTransfersV355Test-1825826473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f050e9e7-5a36-4a41-ab29-0d31d51a3da7 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:53 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f050e9e7-5a36-4a41-ab29-0d31d51a3da7 Sep 07 13:58:53 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:53 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e02a40a0-ae5d-4361-b962-868e916327b4 tempest-VolumesTransfersV355Test-1825826473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f050e9e7-5a36-4a41-ab29-0d31d51a3da7" returned: 0 in 0.368s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e02a40a0-ae5d-4361-b962-868e916327b4 tempest-VolumesTransfersV355Test-1825826473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f050e9e7-5a36-4a41-ab29-0d31d51a3da7 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:53 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f050e9e7-5a36-4a41-ab29-0d31d51a3da7 Sep 07 13:58:53 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:53 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e02a40a0-ae5d-4361-b962-868e916327b4 tempest-VolumesTransfersV355Test-1825826473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f050e9e7-5a36-4a41-ab29-0d31d51a3da7" returned: 0 in 0.260s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:53 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e02a40a0-ae5d-4361-b962-868e916327b4 tempest-VolumesTransfersV355Test-1825826473 None] Lock "cinder-quobyte-f050e9e7-5a36-4a41-ab29-0d31d51a3da7" released by "delete_volume" :: held 0.677s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:53 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-e02a40a0-ae5d-4361-b962-868e916327b4 tempest-VolumesTransfersV355Test-1825826473 None] Created reservations ['4e762dfd-7006-4d5e-b155-0606f1aef1ab', '91f7bb3e-3ee7-4a23-9588-4f45aef00027', '48c6c582-bb54-4592-87b8-e9fa141008fb', '18f34360-5397-4f31-b999-12b9511ad8a4'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e02a40a0-ae5d-4361-b962-868e916327b4 tempest-VolumesTransfersV355Test-1825826473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e02a40a0-ae5d-4361-b962-868e916327b4 tempest-VolumesTransfersV355Test-1825826473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e02a40a0-ae5d-4361-b962-868e916327b4 tempest-VolumesTransfersV355Test-1825826473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e02a40a0-ae5d-4361-b962-868e916327b4 tempest-VolumesTransfersV355Test-1825826473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e02a40a0-ae5d-4361-b962-868e916327b4 tempest-VolumesTransfersV355Test-1825826473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e02a40a0-ae5d-4361-b962-868e916327b4 tempest-VolumesTransfersV355Test-1825826473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:53 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:58:53 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:53 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:58:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Flow 'volume_create_manager' (c04c1a9a-4a62-4e83-9f86-e5a037dbfd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d3cc45-a099-4c89-ac33-485bc87787e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d3cc45-a099-4c89-ac33-485bc87787e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-602696074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e55de2-3248-4dda-a564-59a74ca54292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0edb9c730d5047caaa3090c48a05c60d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:54Z,use_quota=True,user_id='d05fb48325b944448e7c7c6ef80b257d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf88b34-7d7c-482c-a35b-084de530b16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf88b34-7d7c-482c-a35b-084de530b16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ddc484e-dc19-45ad-8a3f-8fab18483454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ddc484e-dc19-45ad-8a3f-8fab18483454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33e55de2-3248-4dda-a564-59a74ca54292', 'volume_name': 'volume-33e55de2-3248-4dda-a564-59a74ca54292', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599ed423-e65a-473d-a2dd-5a10930480ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599ed423-e65a-473d-a2dd-5a10930480ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130601e6-d313-4bf1-86cf-27a97404b8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:54 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Volume 33e55de2-3248-4dda-a564-59a74ca54292: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33e55de2-3248-4dda-a564-59a74ca54292', 'volume_size': 1} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-602696074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e55de2-3248-4dda-a564-59a74ca54292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0edb9c730d5047caaa3090c48a05c60d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:54Z,use_quota=True,user_id='d05fb48325b944448e7c7c6ef80b257d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Creating volume 33e55de2-3248-4dda-a564-59a74ca54292 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:54 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33e55de2-3248-4dda-a564-59a74ca54292 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:54 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33e55de2-3248-4dda-a564-59a74ca54292 1073741824 Sep 07 13:58:54 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:54 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e02a40a0-ae5d-4361-b962-868e916327b4 tempest-VolumesTransfersV355Test-1825826473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.268s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-e02a40a0-ae5d-4361-b962-868e916327b4 tempest-VolumesTransfersV355Test-1825826473 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:54 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-e02a40a0-ae5d-4361-b962-868e916327b4 tempest-VolumesTransfersV355Test-1825826473 None] Deleted volume successfully. Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-e02a40a0-ae5d-4361-b962-868e916327b4 tempest-VolumesTransfersV355Test-1825826473 None] Lock "cinder-f050e9e7-5a36-4a41-ab29-0d31d51a3da7-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:54 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33e55de2-3248-4dda-a564-59a74ca54292 1073741824" returned: 0 in 0.473s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33e55de2-3248-4dda-a564-59a74ca54292 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:54 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33e55de2-3248-4dda-a564-59a74ca54292 Sep 07 13:58:54 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:54 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33e55de2-3248-4dda-a564-59a74ca54292" returned: 0 in 0.248s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130601e6-d313-4bf1-86cf-27a97404b8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33e55de2-3248-4dda-a564-59a74ca54292', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c7ec12-2ef5-4bd1-900b-26c27696ca5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:54 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Volume volume-33e55de2-3248-4dda-a564-59a74ca54292 (33e55de2-3248-4dda-a564-59a74ca54292): created successfully Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c7ec12-2ef5-4bd1-900b-26c27696ca5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Flow 'volume_create_manager' (c04c1a9a-4a62-4e83-9f86-e5a037dbfd59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:54 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-f76099ff-6eae-4f50-b049-d3083102a527 tempest-ProjectReaderTests-74717841 None] Created volume successfully. Sep 07 13:58:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b4ff3355-6e04-4941-8400-019657e703a8 tempest-ProjectReaderTests-74717841 None] Acquiring lock "cinder-33e55de2-3248-4dda-a564-59a74ca54292-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b4ff3355-6e04-4941-8400-019657e703a8 tempest-ProjectReaderTests-74717841 None] Lock "cinder-33e55de2-3248-4dda-a564-59a74ca54292-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b4ff3355-6e04-4941-8400-019657e703a8 tempest-ProjectReaderTests-74717841 None] Acquiring lock "cinder-quobyte-33e55de2-3248-4dda-a564-59a74ca54292" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b4ff3355-6e04-4941-8400-019657e703a8 tempest-ProjectReaderTests-74717841 None] Lock "cinder-quobyte-33e55de2-3248-4dda-a564-59a74ca54292" acquired by "delete_volume" :: waited 0.019s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:56 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e51fc98-958b-49d4-bfdb-1689a28a59a7]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b4ff3355-6e04-4941-8400-019657e703a8 tempest-ProjectReaderTests-74717841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33e55de2-3248-4dda-a564-59a74ca54292 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:56 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33e55de2-3248-4dda-a564-59a74ca54292 Sep 07 13:58:56 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:56 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b4ff3355-6e04-4941-8400-019657e703a8 tempest-ProjectReaderTests-74717841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33e55de2-3248-4dda-a564-59a74ca54292" returned: 0 in 0.381s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b4ff3355-6e04-4941-8400-019657e703a8 tempest-ProjectReaderTests-74717841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33e55de2-3248-4dda-a564-59a74ca54292 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:56 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33e55de2-3248-4dda-a564-59a74ca54292 Sep 07 13:58:56 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:56 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b4ff3355-6e04-4941-8400-019657e703a8 tempest-ProjectReaderTests-74717841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-33e55de2-3248-4dda-a564-59a74ca54292" returned: 0 in 0.251s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b4ff3355-6e04-4941-8400-019657e703a8 tempest-ProjectReaderTests-74717841 None] Lock "cinder-quobyte-33e55de2-3248-4dda-a564-59a74ca54292" released by "delete_volume" :: held 0.674s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:57 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-b4ff3355-6e04-4941-8400-019657e703a8 tempest-ProjectReaderTests-74717841 None] Created reservations ['1a99f9a4-7aae-47f3-9317-60bbc38bb11a', '6fc836e3-0538-4ea7-bd45-d927d85c95dd', '42d96e40-76f2-498b-a954-5808d118e52b', '7bfe93f0-dee8-49bd-9010-2c144d75c188'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b4ff3355-6e04-4941-8400-019657e703a8 tempest-ProjectReaderTests-74717841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b4ff3355-6e04-4941-8400-019657e703a8 tempest-ProjectReaderTests-74717841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b4ff3355-6e04-4941-8400-019657e703a8 tempest-ProjectReaderTests-74717841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b4ff3355-6e04-4941-8400-019657e703a8 tempest-ProjectReaderTests-74717841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b4ff3355-6e04-4941-8400-019657e703a8 tempest-ProjectReaderTests-74717841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b4ff3355-6e04-4941-8400-019657e703a8 tempest-ProjectReaderTests-74717841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:57 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:58:57 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:57 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b4ff3355-6e04-4941-8400-019657e703a8 tempest-ProjectReaderTests-74717841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.265s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:57 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-b4ff3355-6e04-4941-8400-019657e703a8 tempest-ProjectReaderTests-74717841 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:57 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-b4ff3355-6e04-4941-8400-019657e703a8 tempest-ProjectReaderTests-74717841 None] Deleted volume successfully. Sep 07 13:58:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b4ff3355-6e04-4941-8400-019657e703a8 tempest-ProjectReaderTests-74717841 None] Lock "cinder-33e55de2-3248-4dda-a564-59a74ca54292-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:57 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:58:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Flow 'volume_create_manager' (e4239dfa-0d56-4b3c-98f8-139d1eef0f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36066751-fc8c-40b0-bd11-1648f8907a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36066751-fc8c-40b0-bd11-1648f8907a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-962427912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75176de6-84a7-4144-9730-284628cdcd91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0edb9c730d5047caaa3090c48a05c60d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:58Z,use_quota=True,user_id='d05fb48325b944448e7c7c6ef80b257d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a3e13b-3cde-40a2-8090-d0214958082a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a3e13b-3cde-40a2-8090-d0214958082a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd734e6-eab9-4328-b55a-d9d5c86fc9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd734e6-eab9-4328-b55a-d9d5c86fc9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75176de6-84a7-4144-9730-284628cdcd91', 'volume_name': 'volume-75176de6-84a7-4144-9730-284628cdcd91', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59201dd3-6aa5-4864-9d33-e555b76be917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59201dd3-6aa5-4864-9d33-e555b76be917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c99ff8f1-aae8-48c0-82f2-2e60c9a9cc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:58 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Volume 75176de6-84a7-4144-9730-284628cdcd91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75176de6-84a7-4144-9730-284628cdcd91', 'volume_size': 1} Sep 07 13:58:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-962427912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75176de6-84a7-4144-9730-284628cdcd91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0edb9c730d5047caaa3090c48a05c60d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:58Z,use_quota=True,user_id='d05fb48325b944448e7c7c6ef80b257d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Creating volume 75176de6-84a7-4144-9730-284628cdcd91 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:58 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:58:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75176de6-84a7-4144-9730-284628cdcd91 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:58 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75176de6-84a7-4144-9730-284628cdcd91 1073741824 Sep 07 13:58:58 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:58 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75176de6-84a7-4144-9730-284628cdcd91 1073741824" returned: 0 in 0.465s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75176de6-84a7-4144-9730-284628cdcd91 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:58 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75176de6-84a7-4144-9730-284628cdcd91 Sep 07 13:58:58 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:58 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75176de6-84a7-4144-9730-284628cdcd91" returned: 0 in 0.254s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c99ff8f1-aae8-48c0-82f2-2e60c9a9cc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75176de6-84a7-4144-9730-284628cdcd91', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d247798-49f5-47f1-8d1e-1e711a549a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:58 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Volume volume-75176de6-84a7-4144-9730-284628cdcd91 (75176de6-84a7-4144-9730-284628cdcd91): created successfully Sep 07 13:58:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d247798-49f5-47f1-8d1e-1e711a549a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Flow 'volume_create_manager' (e4239dfa-0d56-4b3c-98f8-139d1eef0f8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:58 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-de429ddc-7261-4243-99dd-23df0586f6f3 tempest-ProjectReaderTests-74717841 None] Created volume successfully. Sep 07 13:58:59 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-66c35c78-3280-4574-8964-70e9a9d4d1d0 tempest-ProjectReaderTests-74717841 None] Acquiring lock "cinder-75176de6-84a7-4144-9730-284628cdcd91-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:59 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-66c35c78-3280-4574-8964-70e9a9d4d1d0 tempest-ProjectReaderTests-74717841 None] Lock "cinder-75176de6-84a7-4144-9730-284628cdcd91-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:59 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-66c35c78-3280-4574-8964-70e9a9d4d1d0 tempest-ProjectReaderTests-74717841 None] Acquiring lock "cinder-quobyte-75176de6-84a7-4144-9730-284628cdcd91" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:59 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-66c35c78-3280-4574-8964-70e9a9d4d1d0 tempest-ProjectReaderTests-74717841 None] Lock "cinder-quobyte-75176de6-84a7-4144-9730-284628cdcd91" acquired by "delete_volume" :: waited 0.016s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:59 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d57a2e6-536e-428b-91ed-47c6d48cf45f]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-66c35c78-3280-4574-8964-70e9a9d4d1d0 tempest-ProjectReaderTests-74717841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75176de6-84a7-4144-9730-284628cdcd91 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:59 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75176de6-84a7-4144-9730-284628cdcd91 Sep 07 13:58:59 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:59 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-66c35c78-3280-4574-8964-70e9a9d4d1d0 tempest-ProjectReaderTests-74717841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75176de6-84a7-4144-9730-284628cdcd91" returned: 0 in 0.372s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-66c35c78-3280-4574-8964-70e9a9d4d1d0 tempest-ProjectReaderTests-74717841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75176de6-84a7-4144-9730-284628cdcd91 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:59 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75176de6-84a7-4144-9730-284628cdcd91 Sep 07 13:58:59 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:59 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-66c35c78-3280-4574-8964-70e9a9d4d1d0 tempest-ProjectReaderTests-74717841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-75176de6-84a7-4144-9730-284628cdcd91" returned: 0 in 0.267s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:59 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-66c35c78-3280-4574-8964-70e9a9d4d1d0 tempest-ProjectReaderTests-74717841 None] Lock "cinder-quobyte-75176de6-84a7-4144-9730-284628cdcd91" released by "delete_volume" :: held 0.690s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:59 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-66c35c78-3280-4574-8964-70e9a9d4d1d0 tempest-ProjectReaderTests-74717841 None] Created reservations ['1c93b3c3-91a6-456a-8488-6b67eb1eb9f3', '5bc193a7-77da-4e4b-8e65-a868d21a5a6b', '7eec2827-8d42-4824-96ec-4ea00fb1bc4b', 'b831adbe-6111-4e08-8da1-4cb84d568785'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-66c35c78-3280-4574-8964-70e9a9d4d1d0 tempest-ProjectReaderTests-74717841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-66c35c78-3280-4574-8964-70e9a9d4d1d0 tempest-ProjectReaderTests-74717841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:59 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-66c35c78-3280-4574-8964-70e9a9d4d1d0 tempest-ProjectReaderTests-74717841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:59 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-66c35c78-3280-4574-8964-70e9a9d4d1d0 tempest-ProjectReaderTests-74717841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-66c35c78-3280-4574-8964-70e9a9d4d1d0 tempest-ProjectReaderTests-74717841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-66c35c78-3280-4574-8964-70e9a9d4d1d0 tempest-ProjectReaderTests-74717841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:00 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:59:00 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:00 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-66c35c78-3280-4574-8964-70e9a9d4d1d0 tempest-ProjectReaderTests-74717841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.321s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-66c35c78-3280-4574-8964-70e9a9d4d1d0 tempest-ProjectReaderTests-74717841 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:59:00 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-66c35c78-3280-4574-8964-70e9a9d4d1d0 tempest-ProjectReaderTests-74717841 None] Deleted volume successfully. Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-66c35c78-3280-4574-8964-70e9a9d4d1d0 tempest-ProjectReaderTests-74717841 None] Lock "cinder-75176de6-84a7-4144-9730-284628cdcd91-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Flow 'volume_create_manager' (f94c4761-6c0c-494e-9f2a-37849c8ecb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b51af7b0-77aa-49e2-b118-345ffbf8d9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b51af7b0-77aa-49e2-b118-345ffbf8d9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-35295525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8e8eb7-70d4-423b-8e64-566fedeaecea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0edb9c730d5047caaa3090c48a05c60d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:59:01Z,use_quota=True,user_id='d05fb48325b944448e7c7c6ef80b257d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668b136c-1703-4cc3-9040-0ecee2ed4f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668b136c-1703-4cc3-9040-0ecee2ed4f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6208850b-3766-4526-9eb6-9009a79d01ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6208850b-3766-4526-9eb6-9009a79d01ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f8e8eb7-70d4-423b-8e64-566fedeaecea', 'volume_name': 'volume-7f8e8eb7-70d4-423b-8e64-566fedeaecea', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089bffd1-fc9c-40a0-b315-09bd7e0da2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089bffd1-fc9c-40a0-b315-09bd7e0da2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ceb02d9-f3ca-4c5b-926c-9e2ac08e0113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:00 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Volume 7f8e8eb7-70d4-423b-8e64-566fedeaecea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f8e8eb7-70d4-423b-8e64-566fedeaecea', 'volume_size': 1} Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-35295525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8e8eb7-70d4-423b-8e64-566fedeaecea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0edb9c730d5047caaa3090c48a05c60d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:59:01Z,use_quota=True,user_id='d05fb48325b944448e7c7c6ef80b257d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Creating volume 7f8e8eb7-70d4-423b-8e64-566fedeaecea {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:59:00 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:59:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8e8eb7-70d4-423b-8e64-566fedeaecea 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:00 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8e8eb7-70d4-423b-8e64-566fedeaecea 1073741824 Sep 07 13:59:00 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:01 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8e8eb7-70d4-423b-8e64-566fedeaecea 1073741824" returned: 0 in 0.483s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8e8eb7-70d4-423b-8e64-566fedeaecea {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:01 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8e8eb7-70d4-423b-8e64-566fedeaecea Sep 07 13:59:01 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:01 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8e8eb7-70d4-423b-8e64-566fedeaecea" returned: 0 in 0.285s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:59:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ceb02d9-f3ca-4c5b-926c-9e2ac08e0113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f8e8eb7-70d4-423b-8e64-566fedeaecea', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a87444fa-cdab-4c9f-a976-488e1aa84b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:01 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Volume volume-7f8e8eb7-70d4-423b-8e64-566fedeaecea (7f8e8eb7-70d4-423b-8e64-566fedeaecea): created successfully Sep 07 13:59:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a87444fa-cdab-4c9f-a976-488e1aa84b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Flow 'volume_create_manager' (f94c4761-6c0c-494e-9f2a-37849c8ecb2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:59:01 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-04a95cf5-287a-4e84-8545-d105683456df tempest-ProjectReaderTests-74717841 None] Created volume successfully. Sep 07 13:59:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d2175572-2909-4feb-a650-c41ac56d424e tempest-ProjectReaderTests-74717841 None] Acquiring lock "cinder-7f8e8eb7-70d4-423b-8e64-566fedeaecea-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d2175572-2909-4feb-a650-c41ac56d424e tempest-ProjectReaderTests-74717841 None] Lock "cinder-7f8e8eb7-70d4-423b-8e64-566fedeaecea-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:03 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d2175572-2909-4feb-a650-c41ac56d424e tempest-ProjectReaderTests-74717841 None] Acquiring lock "cinder-quobyte-7f8e8eb7-70d4-423b-8e64-566fedeaecea" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:03 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d2175572-2909-4feb-a650-c41ac56d424e tempest-ProjectReaderTests-74717841 None] Lock "cinder-quobyte-7f8e8eb7-70d4-423b-8e64-566fedeaecea" acquired by "delete_volume" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:03 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[50948d92-58da-4eb7-92d5-04e93e13cf25]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d2175572-2909-4feb-a650-c41ac56d424e tempest-ProjectReaderTests-74717841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8e8eb7-70d4-423b-8e64-566fedeaecea {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:03 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8e8eb7-70d4-423b-8e64-566fedeaecea Sep 07 13:59:03 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:03 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d2175572-2909-4feb-a650-c41ac56d424e tempest-ProjectReaderTests-74717841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8e8eb7-70d4-423b-8e64-566fedeaecea" returned: 0 in 0.392s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d2175572-2909-4feb-a650-c41ac56d424e tempest-ProjectReaderTests-74717841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8e8eb7-70d4-423b-8e64-566fedeaecea {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:03 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8e8eb7-70d4-423b-8e64-566fedeaecea Sep 07 13:59:03 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:03 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d2175572-2909-4feb-a650-c41ac56d424e tempest-ProjectReaderTests-74717841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8e8eb7-70d4-423b-8e64-566fedeaecea" returned: 0 in 0.241s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:03 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d2175572-2909-4feb-a650-c41ac56d424e tempest-ProjectReaderTests-74717841 None] Lock "cinder-quobyte-7f8e8eb7-70d4-423b-8e64-566fedeaecea" released by "delete_volume" :: held 0.677s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:03 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-d2175572-2909-4feb-a650-c41ac56d424e tempest-ProjectReaderTests-74717841 None] Created reservations ['f3451298-5ddb-4808-9974-ac7736978466', '039ffee9-cec1-4061-92d4-ba011128efd9', 'b2263946-d155-48ea-a420-1c7e6248b17b', '5c431b5e-ba01-4b15-b241-510fb57a6afd'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:59:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d2175572-2909-4feb-a650-c41ac56d424e tempest-ProjectReaderTests-74717841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d2175572-2909-4feb-a650-c41ac56d424e tempest-ProjectReaderTests-74717841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:03 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d2175572-2909-4feb-a650-c41ac56d424e tempest-ProjectReaderTests-74717841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:03 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d2175572-2909-4feb-a650-c41ac56d424e tempest-ProjectReaderTests-74717841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d2175572-2909-4feb-a650-c41ac56d424e tempest-ProjectReaderTests-74717841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d2175572-2909-4feb-a650-c41ac56d424e tempest-ProjectReaderTests-74717841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:03 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:59:03 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:04 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d2175572-2909-4feb-a650-c41ac56d424e tempest-ProjectReaderTests-74717841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.270s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-d2175572-2909-4feb-a650-c41ac56d424e tempest-ProjectReaderTests-74717841 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:59:04 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-d2175572-2909-4feb-a650-c41ac56d424e tempest-ProjectReaderTests-74717841 None] Deleted volume successfully. Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d2175572-2909-4feb-a650-c41ac56d424e tempest-ProjectReaderTests-74717841 None] Lock "cinder-7f8e8eb7-70d4-423b-8e64-566fedeaecea-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Flow 'volume_create_manager' (0cd4f482-afda-43c7-9a4a-570a82283b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ec21c9-f458-4412-85fe-457c974a6b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ec21c9-f458-4412-85fe-457c974a6b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1292158539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0edb9c730d5047caaa3090c48a05c60d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:59:05Z,use_quota=True,user_id='d05fb48325b944448e7c7c6ef80b257d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff4f5c6-be15-457b-afe6-b900144640fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff4f5c6-be15-457b-afe6-b900144640fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49bbe70-2706-4ae5-9e55-419e0b13e42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49bbe70-2706-4ae5-9e55-419e0b13e42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51', 'volume_name': 'volume-34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eae16cb-9421-4514-9cf0-fa284c3eab4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eae16cb-9421-4514-9cf0-fa284c3eab4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02839b54-3f8a-48ff-aa02-70196a875a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:04 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Volume 34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51', 'volume_size': 1} Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1292158539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0edb9c730d5047caaa3090c48a05c60d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:59:05Z,use_quota=True,user_id='d05fb48325b944448e7c7c6ef80b257d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Creating volume 34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:59:04 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:59:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:04 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51 1073741824 Sep 07 13:59:04 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:05 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51 1073741824" returned: 0 in 0.490s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:05 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51 Sep 07 13:59:05 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:05 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51" returned: 0 in 0.279s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:59:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02839b54-3f8a-48ff-aa02-70196a875a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72adce0a-47e5-422c-a126-fb034188cd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:05 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Volume volume-34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51 (34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51): created successfully Sep 07 13:59:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72adce0a-47e5-422c-a126-fb034188cd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Flow 'volume_create_manager' (0cd4f482-afda-43c7-9a4a-570a82283b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:59:05 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-39e9c922-17e2-4f5d-b703-956f8ccc157a tempest-ProjectReaderTests-74717841 None] Created volume successfully. Sep 07 13:59:06 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-aab31949-9f10-44cb-acd4-136326992944 tempest-ProjectReaderTests-74717841 None] Acquiring lock "cinder-34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:06 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-aab31949-9f10-44cb-acd4-136326992944 tempest-ProjectReaderTests-74717841 None] Lock "cinder-34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:06 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-aab31949-9f10-44cb-acd4-136326992944 tempest-ProjectReaderTests-74717841 None] Acquiring lock "cinder-quobyte-34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:06 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-aab31949-9f10-44cb-acd4-136326992944 tempest-ProjectReaderTests-74717841 None] Lock "cinder-quobyte-34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51" acquired by "delete_volume" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:06 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3289234-6c3c-45dc-bce9-0cd26b27e9b5]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-aab31949-9f10-44cb-acd4-136326992944 tempest-ProjectReaderTests-74717841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:07 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51 Sep 07 13:59:07 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:07 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-aab31949-9f10-44cb-acd4-136326992944 tempest-ProjectReaderTests-74717841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51" returned: 0 in 0.354s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-aab31949-9f10-44cb-acd4-136326992944 tempest-ProjectReaderTests-74717841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:07 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51 Sep 07 13:59:07 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:07 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-aab31949-9f10-44cb-acd4-136326992944 tempest-ProjectReaderTests-74717841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51" returned: 0 in 0.249s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:07 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-aab31949-9f10-44cb-acd4-136326992944 tempest-ProjectReaderTests-74717841 None] Lock "cinder-quobyte-34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51" released by "delete_volume" :: held 0.675s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:07 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-aab31949-9f10-44cb-acd4-136326992944 tempest-ProjectReaderTests-74717841 None] Created reservations ['23a5d63f-9159-43c2-9a87-4ac64e87b2a2', 'e6fb6c88-6779-48af-801b-6f8cc3c8e8be', '01752481-1c76-4a1d-8946-ad7b0e34aafd', 'bf352422-8003-4a14-998f-cf6064bce457'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:59:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-aab31949-9f10-44cb-acd4-136326992944 tempest-ProjectReaderTests-74717841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-aab31949-9f10-44cb-acd4-136326992944 tempest-ProjectReaderTests-74717841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-aab31949-9f10-44cb-acd4-136326992944 tempest-ProjectReaderTests-74717841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-aab31949-9f10-44cb-acd4-136326992944 tempest-ProjectReaderTests-74717841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-aab31949-9f10-44cb-acd4-136326992944 tempest-ProjectReaderTests-74717841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-aab31949-9f10-44cb-acd4-136326992944 tempest-ProjectReaderTests-74717841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:07 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:59:07 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:07 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-aab31949-9f10-44cb-acd4-136326992944 tempest-ProjectReaderTests-74717841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.254s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:07 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-aab31949-9f10-44cb-acd4-136326992944 tempest-ProjectReaderTests-74717841 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:59:07 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-aab31949-9f10-44cb-acd4-136326992944 tempest-ProjectReaderTests-74717841 None] Deleted volume successfully. Sep 07 13:59:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-aab31949-9f10-44cb-acd4-136326992944 tempest-ProjectReaderTests-74717841 None] Lock "cinder-34f0f6a3-2f5c-457d-b8ee-8c5ccac83b51-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:11 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:59:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Flow 'volume_create_manager' (d44be8db-a2f7-4803-9239-ead6123fe45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:59:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2fde146-ee0f-4227-8b5e-70aabc1d0187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2fde146-ee0f-4227-8b5e-70aabc1d0187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1025018239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c042a670-73f4-4253-bcde-456acff7d3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a12e4850f34852bcb741ee1a20c60c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:59:12Z,use_quota=True,user_id='6814fb7b1ab94d968c2643f33894d799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce011819-dddb-480d-baa1-042a2c4e8672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce011819-dddb-480d-baa1-042a2c4e8672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d86fa2-9c38-4370-930f-6b4cf3b40991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d86fa2-9c38-4370-930f-6b4cf3b40991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c042a670-73f4-4253-bcde-456acff7d3b1', 'volume_name': 'volume-c042a670-73f4-4253-bcde-456acff7d3b1', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff47410-6762-4082-aa2d-37af31924d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff47410-6762-4082-aa2d-37af31924d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c14331-ea4b-4cd9-b71e-13f26d8b813c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:11 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Volume c042a670-73f4-4253-bcde-456acff7d3b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c042a670-73f4-4253-bcde-456acff7d3b1', 'volume_size': 1} Sep 07 13:59:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:11 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1025018239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c042a670-73f4-4253-bcde-456acff7d3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a12e4850f34852bcb741ee1a20c60c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:59:12Z,use_quota=True,user_id='6814fb7b1ab94d968c2643f33894d799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:59:11 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Creating volume c042a670-73f4-4253-bcde-456acff7d3b1 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:59:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:11 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:11 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:11 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:59:11 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:59:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:11 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 1073741824 Sep 07 13:59:11 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:12 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 1073741824" returned: 0 in 0.469s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:12 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 Sep 07 13:59:12 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:12 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1" returned: 0 in 0.255s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:59:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:12 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c14331-ea4b-4cd9-b71e-13f26d8b813c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c042a670-73f4-4253-bcde-456acff7d3b1', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:12 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (765f1b91-f2e5-4c9a-a81c-4e485c1aecad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:12 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Volume volume-c042a670-73f4-4253-bcde-456acff7d3b1 (c042a670-73f4-4253-bcde-456acff7d3b1): created successfully Sep 07 13:59:12 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (765f1b91-f2e5-4c9a-a81c-4e485c1aecad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:12 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Flow 'volume_create_manager' (d44be8db-a2f7-4803-9239-ead6123fe45d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:59:12 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-693e0123-26a9-4be7-9202-1f168019a0b9 tempest-VolumesActionsTest-1897150754 None] Created volume successfully. Sep 07 13:59:22 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:INSERT=21,cinder:SELECT=48,cinder:UPDATE=88,cinder:DELETE=6 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:59:22 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=60,cinder:INSERT=22,cinder:UPDATE=70,cinder:DELETE=9 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:59:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1e967106-7f9a-4a04-a9b2-6812c877f715 tempest-VolumesActionsTest-1897150754 None] Acquiring lock "cinder-c042a670-73f4-4253-bcde-456acff7d3b1" by "attach_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1e967106-7f9a-4a04-a9b2-6812c877f715 tempest-VolumesActionsTest-1897150754 None] Lock "cinder-c042a670-73f4-4253-bcde-456acff7d3b1" acquired by "attach_volume" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:23 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-1e967106-7f9a-4a04-a9b2-6812c877f715 tempest-VolumesActionsTest-1897150754 None] Attaching volume c042a670-73f4-4253-bcde-456acff7d3b1 to instance 52d7fa61-7f2e-4e5d-924c-4ac699292678 at mountpoint /dev/vdb on host None. Sep 07 13:59:23 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-1e967106-7f9a-4a04-a9b2-6812c877f715 tempest-VolumesActionsTest-1897150754 None] Attach volume completed successfully. Sep 07 13:59:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1e967106-7f9a-4a04-a9b2-6812c877f715 tempest-VolumesActionsTest-1897150754 None] Lock "cinder-c042a670-73f4-4253-bcde-456acff7d3b1" released by "attach_volume" :: held 0.102s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ee6c9ed2-cdbe-4514-a162-d66ce778cd7d tempest-VolumesActionsTest-1897150754 None] Acquiring lock "cinder-c042a670-73f4-4253-bcde-456acff7d3b1-detach_volume" by "detach_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ee6c9ed2-cdbe-4514-a162-d66ce778cd7d tempest-VolumesActionsTest-1897150754 None] Lock "cinder-c042a670-73f4-4253-bcde-456acff7d3b1-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:23 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-ee6c9ed2-cdbe-4514-a162-d66ce778cd7d tempest-VolumesActionsTest-1897150754 None] Detaching volume c042a670-73f4-4253-bcde-456acff7d3b1 from instance 52d7fa61-7f2e-4e5d-924c-4ac699292678. Sep 07 13:59:23 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-ee6c9ed2-cdbe-4514-a162-d66ce778cd7d tempest-VolumesActionsTest-1897150754 None] Detach volume completed successfully. Sep 07 13:59:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ee6c9ed2-cdbe-4514-a162-d66ce778cd7d tempest-VolumesActionsTest-1897150754 None] Lock "cinder-c042a670-73f4-4253-bcde-456acff7d3b1-detach_volume" released by "detach_volume" :: held 0.071s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:59:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:28 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:59:28 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:28 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.297s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:59:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager._thread_info {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:59:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread count: 28 {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:59:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread info: [<_MainThread(MainThread, started 132147689414784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:59:31 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:59:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Flow 'volume_create_manager' (9c39e458-b044-408f-8715-d3246e5e96f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:59:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931a4a27-72fa-419e-b900-aa1dfeb7af6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931a4a27-72fa-419e-b900-aa1dfeb7af6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-613782597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=587d3c25-6fc8-484e-8192-738ff96e4887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece9a540975f47b0bd3d43b3a302c901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:59:32Z,use_quota=True,user_id='4e5d1fd2e9fb4265bd8f78217f918298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65d5545-69c0-49d5-a52b-9f931350c1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65d5545-69c0-49d5-a52b-9f931350c1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0512604e-64e7-42f8-bcec-8a615cff2855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0512604e-64e7-42f8-bcec-8a615cff2855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '587d3c25-6fc8-484e-8192-738ff96e4887', 'volume_name': 'volume-587d3c25-6fc8-484e-8192-738ff96e4887', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27eb5e17-dcc6-4819-9b7e-7a1a5e728044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27eb5e17-dcc6-4819-9b7e-7a1a5e728044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:31 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3e963c-1726-4173-85e4-770b5b3973c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:31 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Volume 587d3c25-6fc8-484e-8192-738ff96e4887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-587d3c25-6fc8-484e-8192-738ff96e4887', 'volume_size': 1} Sep 07 13:59:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-613782597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=587d3c25-6fc8-484e-8192-738ff96e4887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece9a540975f47b0bd3d43b3a302c901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:59:32Z,use_quota=True,user_id='4e5d1fd2e9fb4265bd8f78217f918298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:59:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Creating volume 587d3c25-6fc8-484e-8192-738ff96e4887 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:59:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:59:31 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 13:59:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:31 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887 1073741824 Sep 07 13:59:31 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:32 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887 1073741824" returned: 0 in 0.536s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:32 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887 Sep 07 13:59:32 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:32 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887" returned: 0 in 0.244s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:32 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:59:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3e963c-1726-4173-85e4-770b5b3973c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-587d3c25-6fc8-484e-8192-738ff96e4887', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a02d1b-374b-4676-932a-8d9d1f49fc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:32 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Volume volume-587d3c25-6fc8-484e-8192-738ff96e4887 (587d3c25-6fc8-484e-8192-738ff96e4887): created successfully Sep 07 13:59:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a02d1b-374b-4676-932a-8d9d1f49fc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:32 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Flow 'volume_create_manager' (9c39e458-b044-408f-8715-d3246e5e96f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:59:32 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-98944f4c-eda5-4d83-8ce0-751dccf659b8 tempest-SnapshotDependencyTests-220491941 None] Created volume successfully. Sep 07 13:59:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-92b17322-7164-46ec-8dc7-bdde7ba59b51 tempest-SnapshotDependencyTests-220491941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-92b17322-7164-46ec-8dc7-bdde7ba59b51 tempest-SnapshotDependencyTests-220491941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-92b17322-7164-46ec-8dc7-bdde7ba59b51 tempest-SnapshotDependencyTests-220491941 None] Creating offline snapshot 477579d0-d51d-4e96-b2b6-925f8fe44161 of volume 587d3c25-6fc8-484e-8192-738ff96e4887 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:59:34 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4148d12-ee8f-4322-8cc9-d1be485f056a]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-92b17322-7164-46ec-8dc7-bdde7ba59b51 tempest-SnapshotDependencyTests-220491941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:34 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887 Sep 07 13:59:34 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:34 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-92b17322-7164-46ec-8dc7-bdde7ba59b51 tempest-SnapshotDependencyTests-220491941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887" returned: 0 in 0.519s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-92b17322-7164-46ec-8dc7-bdde7ba59b51 tempest-SnapshotDependencyTests-220491941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.477579d0-d51d-4e96-b2b6-925f8fe44161 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:34 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.477579d0-d51d-4e96-b2b6-925f8fe44161 1G Sep 07 13:59:34 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:35 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-92b17322-7164-46ec-8dc7-bdde7ba59b51 tempest-SnapshotDependencyTests-220491941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.477579d0-d51d-4e96-b2b6-925f8fe44161 1G" returned: 0 in 0.526s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-92b17322-7164-46ec-8dc7-bdde7ba59b51 tempest-SnapshotDependencyTests-220491941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-587d3c25-6fc8-484e-8192-738ff96e4887 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.477579d0-d51d-4e96-b2b6-925f8fe44161 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:35 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-587d3c25-6fc8-484e-8192-738ff96e4887 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.477579d0-d51d-4e96-b2b6-925f8fe44161 Sep 07 13:59:35 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:35 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-92b17322-7164-46ec-8dc7-bdde7ba59b51 tempest-SnapshotDependencyTests-220491941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-587d3c25-6fc8-484e-8192-738ff96e4887 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.477579d0-d51d-4e96-b2b6-925f8fe44161" returned: 0 in 0.359s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:35 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-92b17322-7164-46ec-8dc7-bdde7ba59b51 tempest-SnapshotDependencyTests-220491941 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.477579d0-d51d-4e96-b2b6-925f8fe44161 is being set with open permissions: ugo+rw Sep 07 13:59:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-92b17322-7164-46ec-8dc7-bdde7ba59b51 tempest-SnapshotDependencyTests-220491941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.477579d0-d51d-4e96-b2b6-925f8fe44161 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:35 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.477579d0-d51d-4e96-b2b6-925f8fe44161 Sep 07 13:59:35 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:36 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-92b17322-7164-46ec-8dc7-bdde7ba59b51 tempest-SnapshotDependencyTests-220491941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.477579d0-d51d-4e96-b2b6-925f8fe44161" returned: 0 in 0.251s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-92b17322-7164-46ec-8dc7-bdde7ba59b51 tempest-SnapshotDependencyTests-220491941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:36 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.info Sep 07 13:59:36 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:36 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-92b17322-7164-46ec-8dc7-bdde7ba59b51 tempest-SnapshotDependencyTests-220491941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.info" returned: 0 in 0.282s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:36 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-92b17322-7164-46ec-8dc7-bdde7ba59b51 tempest-SnapshotDependencyTests-220491941 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.info is being set with open permissions: ugo+rw Sep 07 13:59:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-92b17322-7164-46ec-8dc7-bdde7ba59b51 tempest-SnapshotDependencyTests-220491941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:36 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06cf9d3f-ba6b-4cce-8228-2d049a9ecd41 tempest-VolumesActionsTest-1897150754 None] Acquiring lock "cinder-c042a670-73f4-4253-bcde-456acff7d3b1" by "attach_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:36 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.info Sep 07 13:59:36 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:36 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06cf9d3f-ba6b-4cce-8228-2d049a9ecd41 tempest-VolumesActionsTest-1897150754 None] Lock "cinder-c042a670-73f4-4253-bcde-456acff7d3b1" acquired by "attach_volume" :: waited 0.019s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:36 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-06cf9d3f-ba6b-4cce-8228-2d049a9ecd41 tempest-VolumesActionsTest-1897150754 None] Attaching volume c042a670-73f4-4253-bcde-456acff7d3b1 to instance 88455b78-89e8-4be5-a064-f74e16eac653 at mountpoint /dev/vdb on host None. Sep 07 13:59:36 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-06cf9d3f-ba6b-4cce-8228-2d049a9ecd41 tempest-VolumesActionsTest-1897150754 None] Attach volume completed successfully. Sep 07 13:59:36 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-06cf9d3f-ba6b-4cce-8228-2d049a9ecd41 tempest-VolumesActionsTest-1897150754 None] Lock "cinder-c042a670-73f4-4253-bcde-456acff7d3b1" released by "attach_volume" :: held 0.095s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:36 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-92b17322-7164-46ec-8dc7-bdde7ba59b51 tempest-SnapshotDependencyTests-220491941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.info" returned: 0 in 0.322s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-92b17322-7164-46ec-8dc7-bdde7ba59b51 tempest-SnapshotDependencyTests-220491941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.387s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:36 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-92b17322-7164-46ec-8dc7-bdde7ba59b51 tempest-SnapshotDependencyTests-220491941 None] Create snapshot completed successfully Sep 07 13:59:36 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2f777ede-6693-456e-ad8b-2bdbec8d2c24 tempest-VolumesActionsTest-1897150754 None] Acquiring lock "cinder-c042a670-73f4-4253-bcde-456acff7d3b1-detach_volume" by "detach_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:36 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2f777ede-6693-456e-ad8b-2bdbec8d2c24 tempest-VolumesActionsTest-1897150754 None] Lock "cinder-c042a670-73f4-4253-bcde-456acff7d3b1-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:36 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-2f777ede-6693-456e-ad8b-2bdbec8d2c24 tempest-VolumesActionsTest-1897150754 None] Detaching volume c042a670-73f4-4253-bcde-456acff7d3b1 from instance 88455b78-89e8-4be5-a064-f74e16eac653. Sep 07 13:59:36 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-2f777ede-6693-456e-ad8b-2bdbec8d2c24 tempest-VolumesActionsTest-1897150754 None] Detach volume completed successfully. Sep 07 13:59:36 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2f777ede-6693-456e-ad8b-2bdbec8d2c24 tempest-VolumesActionsTest-1897150754 None] Lock "cinder-c042a670-73f4-4253-bcde-456acff7d3b1-detach_volume" released by "detach_volume" :: held 0.065s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Flow 'volume_create_manager' (f9f3e58d-93fc-4d69-9b9c-24006dd97029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (797ce873-047e-47f4-a6c2-b83be6585a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (797ce873-047e-47f4-a6c2-b83be6585a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084c111a-bc17-40ac-b8f5-f75f1f55b74a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece9a540975f47b0bd3d43b3a302c901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=477579d0-d51d-4e96-b2b6-925f8fe44161,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:59:38Z,use_quota=True,user_id='4e5d1fd2e9fb4265bd8f78217f918298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be38f5b1-7e53-4bb6-96d4-565ffee7f320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be38f5b1-7e53-4bb6-96d4-565ffee7f320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a136981-63be-4ce3-9f0f-7e3fe97d3719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a136981-63be-4ce3-9f0f-7e3fe97d3719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '084c111a-bc17-40ac-b8f5-f75f1f55b74a', 'volume_name': 'volume-084c111a-bc17-40ac-b8f5-f75f1f55b74a', 'volume_size': 1, 'snapshot_id': '477579d0-d51d-4e96-b2b6-925f8fe44161'}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630ff844-b8f9-4dc1-bbfe-b5a2a78962dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630ff844-b8f9-4dc1-bbfe-b5a2a78962dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb30015-a037-452c-8de5-65ebc3c9def2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:38 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Volume 084c111a-bc17-40ac-b8f5-f75f1f55b74a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-084c111a-bc17-40ac-b8f5-f75f1f55b74a', 'volume_size': 1, 'snapshot_id': '477579d0-d51d-4e96-b2b6-925f8fe44161'} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Acquiring lock "cinder-quobyte-477579d0-d51d-4e96-b2b6-925f8fe44161-084c111a-bc17-40ac-b8f5-f75f1f55b74a" by "_create_volume_from_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Lock "cinder-quobyte-477579d0-d51d-4e96-b2b6-925f8fe44161-084c111a-bc17-40ac-b8f5-f75f1f55b74a" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Creating volume 084c111a-bc17-40ac-b8f5-f75f1f55b74a from snapshot 477579d0-d51d-4e96-b2b6-925f8fe44161 {{(pid=87571) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Acquiring lock "cinder-quobyte-084c111a-bc17-40ac-b8f5-f75f1f55b74a" by "_copy_volume_from_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Lock "cinder-quobyte-084c111a-bc17-40ac-b8f5-f75f1f55b74a" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] snapshot: 477579d0-d51d-4e96-b2b6-925f8fe44161, volume: 084c111a-bc17-40ac-b8f5-f75f1f55b74a, {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c1975f-55a7-4a79-99f8-6d69021b6fa1]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.477579d0-d51d-4e96-b2b6-925f8fe44161 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:38 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.477579d0-d51d-4e96-b2b6-925f8fe44161 Sep 07 13:59:38 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:38 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.477579d0-d51d-4e96-b2b6-925f8fe44161" returned: 0 in 0.424s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-587d3c25-6fc8-484e-8192-738ff96e4887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e9aac7-675a-41ab-b451-ab2e6ea1c967]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:38 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887 Sep 07 13:59:38 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:39 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887" returned: 0 in 0.383s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887 {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 13:59:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Creating direct copy from snapshot {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 13:59:39 devstack cinder-volume[87571]: DEBUG cinder.utils [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Path /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-084c111a-bc17-40ac-b8f5-f75f1f55b74a not found in is_blk_device check {{(pid=87571) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 13:59:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-084c111a-bc17-40ac-b8f5-f75f1f55b74a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:39 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-084c111a-bc17-40ac-b8f5-f75f1f55b74a Sep 07 13:59:39 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:43 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-084c111a-bc17-40ac-b8f5-f75f1f55b74a" returned: 0 in 4.496s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:43 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887, size 1024.00 MB, duration 4.50 sec, destination /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-084c111a-bc17-40ac-b8f5-f75f1f55b74a {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:59:43 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Converted 1024.00 MB image at 227.72 MB/s Sep 07 13:59:43 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-084c111a-bc17-40ac-b8f5-f75f1f55b74a is being set with open permissions: ugo+rw Sep 07 13:59:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-084c111a-bc17-40ac-b8f5-f75f1f55b74a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:43 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-084c111a-bc17-40ac-b8f5-f75f1f55b74a Sep 07 13:59:43 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:43 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-084c111a-bc17-40ac-b8f5-f75f1f55b74a" returned: 0 in 0.240s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Lock "cinder-quobyte-084c111a-bc17-40ac-b8f5-f75f1f55b74a" released by "_copy_volume_from_snapshot" :: held 5.626s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Lock "cinder-quobyte-477579d0-d51d-4e96-b2b6-925f8fe44161-084c111a-bc17-40ac-b8f5-f75f1f55b74a" released by "_create_volume_from_snapshot" :: held 5.687s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.704s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb30015-a037-452c-8de5-65ebc3c9def2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-084c111a-bc17-40ac-b8f5-f75f1f55b74a', 'volume_size': 1, 'snapshot_id': '477579d0-d51d-4e96-b2b6-925f8fe44161'}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b55fcd5-6e5b-43ee-b0a8-92ac5f920d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:44 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Volume volume-084c111a-bc17-40ac-b8f5-f75f1f55b74a (084c111a-bc17-40ac-b8f5-f75f1f55b74a): created successfully Sep 07 13:59:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b55fcd5-6e5b-43ee-b0a8-92ac5f920d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Flow 'volume_create_manager' (f9f3e58d-93fc-4d69-9b9c-24006dd97029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:59:44 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-f437a1d1-0de3-4985-89d7-7ffa16934991 tempest-SnapshotDependencyTests-220491941 None] Created volume successfully. Sep 07 13:59:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-150ee3dc-ff0e-4420-affa-85f2c73dfc20 tempest-VolumesActionsTest-1897150754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-150ee3dc-ff0e-4420-affa-85f2c73dfc20 tempest-VolumesActionsTest-1897150754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:44 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[558bca83-854c-4d3d-a82a-80b455842c85]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-150ee3dc-ff0e-4420-affa-85f2c73dfc20 tempest-VolumesActionsTest-1897150754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:44 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 Sep 07 13:59:44 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:44 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-150ee3dc-ff0e-4420-affa-85f2c73dfc20 tempest-VolumesActionsTest-1897150754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1" returned: 0 in 0.352s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:44 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[20546df9-13a4-49b6-a7ae-b95df6e76e90]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-150ee3dc-ff0e-4420-affa-85f2c73dfc20 tempest-VolumesActionsTest-1897150754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:44 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 Sep 07 13:59:44 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:44 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-150ee3dc-ff0e-4420-affa-85f2c73dfc20 tempest-VolumesActionsTest-1897150754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1" returned: 0 in 0.380s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-150ee3dc-ff0e-4420-affa-85f2c73dfc20 tempest-VolumesActionsTest-1897150754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 /opt/stack/data/cinder/conversion/c042a670-73f4-4253-bcde-456acff7d3b1.temp_image.3446a39d-4c23-42f7-b96b-4fd4b7e3bba9iwtxgfwt.img {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:44 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 /opt/stack/data/cinder/conversion/c042a670-73f4-4253-bcde-456acff7d3b1.temp_image.3446a39d-4c23-42f7-b96b-4fd4b7e3bba9iwtxgfwt.img Sep 07 13:59:44 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3ae75c1a-6eb5-41d1-b518-d364d3de45f2 tempest-SnapshotDependencyTests-220491941 None] Acquiring lock "cinder-477579d0-d51d-4e96-b2b6-925f8fe44161-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3ae75c1a-6eb5-41d1-b518-d364d3de45f2 tempest-SnapshotDependencyTests-220491941 None] Lock "cinder-477579d0-d51d-4e96-b2b6-925f8fe44161-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3ae75c1a-6eb5-41d1-b518-d364d3de45f2 tempest-SnapshotDependencyTests-220491941 None] Acquiring lock "cinder-quobyte-587d3c25-6fc8-484e-8192-738ff96e4887" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3ae75c1a-6eb5-41d1-b518-d364d3de45f2 tempest-SnapshotDependencyTests-220491941 None] Lock "cinder-quobyte-587d3c25-6fc8-484e-8192-738ff96e4887" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:45 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3ae75c1a-6eb5-41d1-b518-d364d3de45f2 tempest-SnapshotDependencyTests-220491941 None] Acquiring lock "cinder-quobyte-477579d0-d51d-4e96-b2b6-925f8fe44161" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:45 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3ae75c1a-6eb5-41d1-b518-d364d3de45f2 tempest-SnapshotDependencyTests-220491941 None] Lock "cinder-quobyte-477579d0-d51d-4e96-b2b6-925f8fe44161" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:45 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-3ae75c1a-6eb5-41d1-b518-d364d3de45f2 tempest-SnapshotDependencyTests-220491941 None] Deleting offline snapshot 477579d0-d51d-4e96-b2b6-925f8fe44161 of volume 587d3c25-6fc8-484e-8192-738ff96e4887 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:59:45 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-3ae75c1a-6eb5-41d1-b518-d364d3de45f2 tempest-SnapshotDependencyTests-220491941 None] snapshot_file for this snap is: volume-587d3c25-6fc8-484e-8192-738ff96e4887.477579d0-d51d-4e96-b2b6-925f8fe44161 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:59:45 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d4b71b-ce5f-4de9-b1d5-bd30cd7fe994]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3ae75c1a-6eb5-41d1-b518-d364d3de45f2 tempest-SnapshotDependencyTests-220491941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.477579d0-d51d-4e96-b2b6-925f8fe44161 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:45 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.477579d0-d51d-4e96-b2b6-925f8fe44161 Sep 07 13:59:45 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:45 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3ae75c1a-6eb5-41d1-b518-d364d3de45f2 tempest-SnapshotDependencyTests-220491941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.477579d0-d51d-4e96-b2b6-925f8fe44161" returned: 0 in 0.498s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:45 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-3ae75c1a-6eb5-41d1-b518-d364d3de45f2 tempest-SnapshotDependencyTests-220491941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-587d3c25-6fc8-484e-8192-738ff96e4887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:59:45 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ac749e-1d68-46ec-b317-c495bb99e778]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3ae75c1a-6eb5-41d1-b518-d364d3de45f2 tempest-SnapshotDependencyTests-220491941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:45 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887 Sep 07 13:59:45 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:46 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3ae75c1a-6eb5-41d1-b518-d364d3de45f2 tempest-SnapshotDependencyTests-220491941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887" returned: 0 in 1.161s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3ae75c1a-6eb5-41d1-b518-d364d3de45f2 tempest-SnapshotDependencyTests-220491941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.477579d0-d51d-4e96-b2b6-925f8fe44161 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:46 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.477579d0-d51d-4e96-b2b6-925f8fe44161 Sep 07 13:59:46 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:47 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3ae75c1a-6eb5-41d1-b518-d364d3de45f2 tempest-SnapshotDependencyTests-220491941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.477579d0-d51d-4e96-b2b6-925f8fe44161" returned: 0 in 1.044s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3ae75c1a-6eb5-41d1-b518-d364d3de45f2 tempest-SnapshotDependencyTests-220491941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.477579d0-d51d-4e96-b2b6-925f8fe44161 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:47 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.477579d0-d51d-4e96-b2b6-925f8fe44161 Sep 07 13:59:47 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:48 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3ae75c1a-6eb5-41d1-b518-d364d3de45f2 tempest-SnapshotDependencyTests-220491941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887.477579d0-d51d-4e96-b2b6-925f8fe44161" returned: 0 in 0.589s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3ae75c1a-6eb5-41d1-b518-d364d3de45f2 tempest-SnapshotDependencyTests-220491941 None] Lock "cinder-quobyte-477579d0-d51d-4e96-b2b6-925f8fe44161" released by "_delete_snapshot" :: held 3.498s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3ae75c1a-6eb5-41d1-b518-d364d3de45f2 tempest-SnapshotDependencyTests-220491941 None] Lock "cinder-quobyte-587d3c25-6fc8-484e-8192-738ff96e4887" released by "delete_snapshot" :: held 3.534s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:48 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-3ae75c1a-6eb5-41d1-b518-d364d3de45f2 tempest-SnapshotDependencyTests-220491941 None] Created reservations ['9e83d94a-fce7-457c-9359-945fce3fd6c5', 'a2275b61-9959-4428-9ff0-8c97229d5bdc', 'dbbac4e9-0c2e-4d25-a434-9341b4328cec', '758e5785-095c-4111-81aa-636f58dd2e81'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:59:48 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-3ae75c1a-6eb5-41d1-b518-d364d3de45f2 tempest-SnapshotDependencyTests-220491941 None] Delete snapshot completed successfully. Sep 07 13:59:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3ae75c1a-6eb5-41d1-b518-d364d3de45f2 tempest-SnapshotDependencyTests-220491941 None] Lock "cinder-477579d0-d51d-4e96-b2b6-925f8fe44161-delete_snapshot" released by "delete_snapshot" :: held 3.872s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:49 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-150ee3dc-ff0e-4420-affa-85f2c73dfc20 tempest-VolumesActionsTest-1897150754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 /opt/stack/data/cinder/conversion/c042a670-73f4-4253-bcde-456acff7d3b1.temp_image.3446a39d-4c23-42f7-b96b-4fd4b7e3bba9iwtxgfwt.img" returned: 0 in 4.428s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:49 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72178fc-c7c5-4084-94a1-86a7e371fdd9]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-150ee3dc-ff0e-4420-affa-85f2c73dfc20 tempest-VolumesActionsTest-1897150754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:49 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-aeb9fc93-8c31-4f93-94ab-d231a54c215e tempest-SnapshotDependencyTests-220491941 None] Acquiring lock "cinder-587d3c25-6fc8-484e-8192-738ff96e4887-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:49 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-aeb9fc93-8c31-4f93-94ab-d231a54c215e tempest-SnapshotDependencyTests-220491941 None] Lock "cinder-587d3c25-6fc8-484e-8192-738ff96e4887-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:49 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-aeb9fc93-8c31-4f93-94ab-d231a54c215e tempest-SnapshotDependencyTests-220491941 None] Acquiring lock "cinder-quobyte-587d3c25-6fc8-484e-8192-738ff96e4887" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:49 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-aeb9fc93-8c31-4f93-94ab-d231a54c215e tempest-SnapshotDependencyTests-220491941 None] Lock "cinder-quobyte-587d3c25-6fc8-484e-8192-738ff96e4887" acquired by "delete_volume" :: waited 0.014s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:49 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 Sep 07 13:59:49 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:49 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1e68b3-b272-4d78-90f5-81eaa24359bb]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-aeb9fc93-8c31-4f93-94ab-d231a54c215e tempest-SnapshotDependencyTests-220491941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:49 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887 Sep 07 13:59:49 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:49 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-aeb9fc93-8c31-4f93-94ab-d231a54c215e tempest-SnapshotDependencyTests-220491941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887" returned: 0 in 0.381s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-aeb9fc93-8c31-4f93-94ab-d231a54c215e tempest-SnapshotDependencyTests-220491941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:49 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887 Sep 07 13:59:49 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:49 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-150ee3dc-ff0e-4420-affa-85f2c73dfc20 tempest-VolumesActionsTest-1897150754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1" returned: 0 in 0.574s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:49 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-150ee3dc-ff0e-4420-affa-85f2c73dfc20 tempest-VolumesActionsTest-1897150754 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1, size 1024.00 MB, duration 4.43 sec, destination /opt/stack/data/cinder/conversion/c042a670-73f4-4253-bcde-456acff7d3b1.temp_image.3446a39d-4c23-42f7-b96b-4fd4b7e3bba9iwtxgfwt.img {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:59:49 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-150ee3dc-ff0e-4420-affa-85f2c73dfc20 tempest-VolumesActionsTest-1897150754 None] Converted 1024.00 MB image at 231.18 MB/s Sep 07 13:59:49 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-150ee3dc-ff0e-4420-affa-85f2c73dfc20 tempest-VolumesActionsTest-1897150754 None] 3446a39d-4c23-42f7-b96b-4fd4b7e3bba9 was raw, no need to convert to raw {{(pid=87571) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 07 13:59:50 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-aeb9fc93-8c31-4f93-94ab-d231a54c215e tempest-SnapshotDependencyTests-220491941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-587d3c25-6fc8-484e-8192-738ff96e4887" returned: 0 in 0.289s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:50 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-aeb9fc93-8c31-4f93-94ab-d231a54c215e tempest-SnapshotDependencyTests-220491941 None] Lock "cinder-quobyte-587d3c25-6fc8-484e-8192-738ff96e4887" released by "delete_volume" :: held 0.730s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:50 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-aeb9fc93-8c31-4f93-94ab-d231a54c215e tempest-SnapshotDependencyTests-220491941 None] Created reservations ['9d5590ee-ebf3-48a1-a792-85a028b0cd53', 'fb1d72de-e5b5-48c1-8f7d-aa193c2429aa', 'adce0e7c-523e-48ac-9679-ded47c70478f', '8dca88c4-d00d-49c6-b35e-162e80b5ab94'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:59:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-aeb9fc93-8c31-4f93-94ab-d231a54c215e tempest-SnapshotDependencyTests-220491941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-aeb9fc93-8c31-4f93-94ab-d231a54c215e tempest-SnapshotDependencyTests-220491941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:50 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-aeb9fc93-8c31-4f93-94ab-d231a54c215e tempest-SnapshotDependencyTests-220491941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:50 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-aeb9fc93-8c31-4f93-94ab-d231a54c215e tempest-SnapshotDependencyTests-220491941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-aeb9fc93-8c31-4f93-94ab-d231a54c215e tempest-SnapshotDependencyTests-220491941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-aeb9fc93-8c31-4f93-94ab-d231a54c215e tempest-SnapshotDependencyTests-220491941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:50 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:59:50 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:50 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-aeb9fc93-8c31-4f93-94ab-d231a54c215e tempest-SnapshotDependencyTests-220491941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.254s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:50 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-aeb9fc93-8c31-4f93-94ab-d231a54c215e tempest-SnapshotDependencyTests-220491941 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:59:50 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-157a3b7b-5c32-4d0f-8b91-2e343737ebb2 tempest-SnapshotDependencyTests-220491941 None] Acquiring lock "cinder-084c111a-bc17-40ac-b8f5-f75f1f55b74a-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:50 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-aeb9fc93-8c31-4f93-94ab-d231a54c215e tempest-SnapshotDependencyTests-220491941 None] Deleted volume successfully. Sep 07 13:59:50 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-157a3b7b-5c32-4d0f-8b91-2e343737ebb2 tempest-SnapshotDependencyTests-220491941 None] Lock "cinder-084c111a-bc17-40ac-b8f5-f75f1f55b74a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:50 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-aeb9fc93-8c31-4f93-94ab-d231a54c215e tempest-SnapshotDependencyTests-220491941 None] Lock "cinder-587d3c25-6fc8-484e-8192-738ff96e4887-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:50 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-157a3b7b-5c32-4d0f-8b91-2e343737ebb2 tempest-SnapshotDependencyTests-220491941 None] Acquiring lock "cinder-quobyte-084c111a-bc17-40ac-b8f5-f75f1f55b74a" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:50 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-157a3b7b-5c32-4d0f-8b91-2e343737ebb2 tempest-SnapshotDependencyTests-220491941 None] Lock "cinder-quobyte-084c111a-bc17-40ac-b8f5-f75f1f55b74a" acquired by "delete_volume" :: waited 0.015s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:50 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85450cd-772c-4c70-92bb-4fe9f958cb97]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-157a3b7b-5c32-4d0f-8b91-2e343737ebb2 tempest-SnapshotDependencyTests-220491941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-084c111a-bc17-40ac-b8f5-f75f1f55b74a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:50 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-084c111a-bc17-40ac-b8f5-f75f1f55b74a Sep 07 13:59:50 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:51 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-157a3b7b-5c32-4d0f-8b91-2e343737ebb2 tempest-SnapshotDependencyTests-220491941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-084c111a-bc17-40ac-b8f5-f75f1f55b74a" returned: 0 in 0.365s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-157a3b7b-5c32-4d0f-8b91-2e343737ebb2 tempest-SnapshotDependencyTests-220491941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-084c111a-bc17-40ac-b8f5-f75f1f55b74a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:51 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-084c111a-bc17-40ac-b8f5-f75f1f55b74a Sep 07 13:59:51 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:51 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-157a3b7b-5c32-4d0f-8b91-2e343737ebb2 tempest-SnapshotDependencyTests-220491941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-084c111a-bc17-40ac-b8f5-f75f1f55b74a" returned: 0 in 0.267s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-157a3b7b-5c32-4d0f-8b91-2e343737ebb2 tempest-SnapshotDependencyTests-220491941 None] Lock "cinder-quobyte-084c111a-bc17-40ac-b8f5-f75f1f55b74a" released by "delete_volume" :: held 0.680s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:51 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-157a3b7b-5c32-4d0f-8b91-2e343737ebb2 tempest-SnapshotDependencyTests-220491941 None] Created reservations ['86df2887-17b2-4a7a-8491-bf39335f27c8', '1dcc60b2-6667-4f37-be59-42fcb38a8152', '813ea1f5-75b2-4d9b-8c91-b4c97d918fc3', '220b43c7-7e3d-4261-8694-35dc7e1d117b'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:59:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-157a3b7b-5c32-4d0f-8b91-2e343737ebb2 tempest-SnapshotDependencyTests-220491941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-157a3b7b-5c32-4d0f-8b91-2e343737ebb2 tempest-SnapshotDependencyTests-220491941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-157a3b7b-5c32-4d0f-8b91-2e343737ebb2 tempest-SnapshotDependencyTests-220491941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-157a3b7b-5c32-4d0f-8b91-2e343737ebb2 tempest-SnapshotDependencyTests-220491941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-157a3b7b-5c32-4d0f-8b91-2e343737ebb2 tempest-SnapshotDependencyTests-220491941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-157a3b7b-5c32-4d0f-8b91-2e343737ebb2 tempest-SnapshotDependencyTests-220491941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:51 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 13:59:51 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:51 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-157a3b7b-5c32-4d0f-8b91-2e343737ebb2 tempest-SnapshotDependencyTests-220491941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.296s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:51 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-157a3b7b-5c32-4d0f-8b91-2e343737ebb2 tempest-SnapshotDependencyTests-220491941 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:59:51 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-157a3b7b-5c32-4d0f-8b91-2e343737ebb2 tempest-SnapshotDependencyTests-220491941 None] Deleted volume successfully. Sep 07 13:59:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-157a3b7b-5c32-4d0f-8b91-2e343737ebb2 tempest-SnapshotDependencyTests-220491941 None] Lock "cinder-084c111a-bc17-40ac-b8f5-f75f1f55b74a-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:00:01 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=39,cinder:UPDATE=37,cinder:INSERT=12,cinder:DELETE=2 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:00:01 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:INSERT=7,cinder:SELECT=39,cinder:UPDATE=33,cinder:DELETE=3 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:00:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-150ee3dc-ff0e-4420-affa-85f2c73dfc20 tempest-VolumesActionsTest-1897150754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.616s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:00:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-150ee3dc-ff0e-4420-affa-85f2c73dfc20 tempest-VolumesActionsTest-1897150754 None] Uploaded volume to glance image-id: 3446a39d-4c23-42f7-b96b-4fd4b7e3bba9. {{(pid=87571) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 14:00:09 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-150ee3dc-ff0e-4420-affa-85f2c73dfc20 tempest-VolumesActionsTest-1897150754 None] Copy volume to image completed successfully. Sep 07 14:00:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:00:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:00:10 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[839e562d-424f-43c7-8f5f-db7f7e86c344]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:00:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:00:11 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 Sep 07 14:00:11 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:00:11 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Sep 07 14:00:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1" returned: 0 in 0.344s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:00:11 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0688e746-d4d1-4b11-a401-ba8fa2658544]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:00:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:00:11 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 Sep 07 14:00:11 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:00:11 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Sep 07 14:00:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1" returned: 0 in 0.337s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:00:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 /opt/stack/data/cinder/conversion/c042a670-73f4-4253-bcde-456acff7d3b1.temp_image.a2f6d45e-aa78-49b4-93f9-485e6b242761t82d3bfn.img {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:00:11 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 /opt/stack/data/cinder/conversion/c042a670-73f4-4253-bcde-456acff7d3b1.temp_image.a2f6d45e-aa78-49b4-93f9-485e6b242761t82d3bfn.img Sep 07 14:00:11 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:00:15 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Sep 07 14:00:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 /opt/stack/data/cinder/conversion/c042a670-73f4-4253-bcde-456acff7d3b1.temp_image.a2f6d45e-aa78-49b4-93f9-485e6b242761t82d3bfn.img" returned: 0 in 3.672s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:00:15 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ed3ee1-bfb8-4f0f-bacf-f3dee257c45c]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:00:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:00:15 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 Sep 07 14:00:15 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:00:15 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Sep 07 14:00:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1" returned: 0 in 0.498s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:00:15 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1, size 1024.00 MB, duration 3.67 sec, destination /opt/stack/data/cinder/conversion/c042a670-73f4-4253-bcde-456acff7d3b1.temp_image.a2f6d45e-aa78-49b4-93f9-485e6b242761t82d3bfn.img {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 14:00:15 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] Converted 1024.00 MB image at 278.80 MB/s Sep 07 14:00:15 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] a2f6d45e-aa78-49b4-93f9-485e6b242761 was raw, converting to qcow2 {{(pid=87571) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 07 14:00:15 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[105de73c-9347-4797-b9a1-9e9a5a844798]: (4, 'raw') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:00:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c042a670-73f4-4253-bcde-456acff7d3b1.temp_image.a2f6d45e-aa78-49b4-93f9-485e6b242761t82d3bfn.img {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:00:15 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c042a670-73f4-4253-bcde-456acff7d3b1.temp_image.a2f6d45e-aa78-49b4-93f9-485e6b242761t82d3bfn.img Sep 07 14:00:15 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:00:16 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Sep 07 14:00:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c042a670-73f4-4253-bcde-456acff7d3b1.temp_image.a2f6d45e-aa78-49b4-93f9-485e6b242761t82d3bfn.img" returned: 0 in 0.307s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:00:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c042a670-73f4-4253-bcde-456acff7d3b1.temp_image.a2f6d45e-aa78-49b4-93f9-485e6b242761t82d3bfn.img {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:00:16 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c042a670-73f4-4253-bcde-456acff7d3b1.temp_image.a2f6d45e-aa78-49b4-93f9-485e6b242761t82d3bfn.img Sep 07 14:00:16 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:00:16 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Sep 07 14:00:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c042a670-73f4-4253-bcde-456acff7d3b1.temp_image.a2f6d45e-aa78-49b4-93f9-485e6b242761t82d3bfn.img" returned: 1 in 0.305s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:00:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c042a670-73f4-4253-bcde-456acff7d3b1.temp_image.a2f6d45e-aa78-49b4-93f9-485e6b242761t82d3bfn.img' failed. Not Retrying. {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:00:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c042a670-73f4-4253-bcde-456acff7d3b1.temp_image.a2f6d45e-aa78-49b4-93f9-485e6b242761t82d3bfn.img /opt/stack/data/cinder/conversion/vol_upload_vpypzjwi {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:00:16 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c042a670-73f4-4253-bcde-456acff7d3b1.temp_image.a2f6d45e-aa78-49b4-93f9-485e6b242761t82d3bfn.img /opt/stack/data/cinder/conversion/vol_upload_vpypzjwi Sep 07 14:00:16 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:00:16 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Sep 07 14:00:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c042a670-73f4-4253-bcde-456acff7d3b1.temp_image.a2f6d45e-aa78-49b4-93f9-485e6b242761t82d3bfn.img /opt/stack/data/cinder/conversion/vol_upload_vpypzjwi" returned: 0 in 0.245s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:00:16 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] Image conversion details: src /opt/stack/data/cinder/conversion/c042a670-73f4-4253-bcde-456acff7d3b1.temp_image.a2f6d45e-aa78-49b4-93f9-485e6b242761t82d3bfn.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_vpypzjwi {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 14:00:16 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 07 14:00:16 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7830d93-6437-42cc-9b49-08b98fde79d3]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:00:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vpypzjwi {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:00:16 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vpypzjwi Sep 07 14:00:16 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:00:17 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Sep 07 14:00:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vpypzjwi" returned: 0 in 0.316s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:00:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.288s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:00:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] Uploaded volume to glance image-id: a2f6d45e-aa78-49b4-93f9-485e6b242761. {{(pid=87571) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 14:00:18 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-8c9b142a-5f0b-47b4-9568-c52671104f46 tempest-VolumesActionsTest-1897150754 None] Copy volume to image completed successfully. Sep 07 14:00:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4c8b7aff-1e42-4960-baea-6f7fb0014e55 tempest-VolumesActionsTest-1897150754 None] Acquiring lock "cinder-c042a670-73f4-4253-bcde-456acff7d3b1-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:00:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4c8b7aff-1e42-4960-baea-6f7fb0014e55 tempest-VolumesActionsTest-1897150754 None] Lock "cinder-c042a670-73f4-4253-bcde-456acff7d3b1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:00:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4c8b7aff-1e42-4960-baea-6f7fb0014e55 tempest-VolumesActionsTest-1897150754 None] Acquiring lock "cinder-quobyte-c042a670-73f4-4253-bcde-456acff7d3b1" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:00:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4c8b7aff-1e42-4960-baea-6f7fb0014e55 tempest-VolumesActionsTest-1897150754 None] Lock "cinder-quobyte-c042a670-73f4-4253-bcde-456acff7d3b1" acquired by "delete_volume" :: waited 0.013s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:00:19 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[583b82e1-9919-49f6-b57d-1729a3b14f06]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:00:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4c8b7aff-1e42-4960-baea-6f7fb0014e55 tempest-VolumesActionsTest-1897150754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:00:19 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 Sep 07 14:00:19 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:00:19 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Sep 07 14:00:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4c8b7aff-1e42-4960-baea-6f7fb0014e55 tempest-VolumesActionsTest-1897150754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1" returned: 0 in 0.359s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:00:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4c8b7aff-1e42-4960-baea-6f7fb0014e55 tempest-VolumesActionsTest-1897150754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:00:19 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1 Sep 07 14:00:19 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:00:19 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Sep 07 14:00:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4c8b7aff-1e42-4960-baea-6f7fb0014e55 tempest-VolumesActionsTest-1897150754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c042a670-73f4-4253-bcde-456acff7d3b1" returned: 0 in 0.249s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:00:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4c8b7aff-1e42-4960-baea-6f7fb0014e55 tempest-VolumesActionsTest-1897150754 None] Lock "cinder-quobyte-c042a670-73f4-4253-bcde-456acff7d3b1" released by "delete_volume" :: held 0.641s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:00:19 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-4c8b7aff-1e42-4960-baea-6f7fb0014e55 tempest-VolumesActionsTest-1897150754 None] Created reservations ['793a8872-892a-4593-ab28-2c243edb534a', 'c270c732-dd81-4761-b5d8-8580979a4f1b', 'e9f2bc8e-e8ac-4497-987b-f6fbd6215327', '381b09ff-9f17-4a4a-b9e1-8c591b6091b5'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:00:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4c8b7aff-1e42-4960-baea-6f7fb0014e55 tempest-VolumesActionsTest-1897150754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:00:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4c8b7aff-1e42-4960-baea-6f7fb0014e55 tempest-VolumesActionsTest-1897150754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:00:19 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4c8b7aff-1e42-4960-baea-6f7fb0014e55 tempest-VolumesActionsTest-1897150754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:00:19 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4c8b7aff-1e42-4960-baea-6f7fb0014e55 tempest-VolumesActionsTest-1897150754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:00:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4c8b7aff-1e42-4960-baea-6f7fb0014e55 tempest-VolumesActionsTest-1897150754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:00:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4c8b7aff-1e42-4960-baea-6f7fb0014e55 tempest-VolumesActionsTest-1897150754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:00:19 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:00:19 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:00:19 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Sep 07 14:00:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4c8b7aff-1e42-4960-baea-6f7fb0014e55 tempest-VolumesActionsTest-1897150754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.246s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:00:19 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-4c8b7aff-1e42-4960-baea-6f7fb0014e55 tempest-VolumesActionsTest-1897150754 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:00:19 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-4c8b7aff-1e42-4960-baea-6f7fb0014e55 tempest-VolumesActionsTest-1897150754 None] Deleted volume successfully. Sep 07 14:00:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4c8b7aff-1e42-4960-baea-6f7fb0014e55 tempest-VolumesActionsTest-1897150754 None] Lock "cinder-c042a670-73f4-4253-bcde-456acff7d3b1-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:00:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:00:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:00:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:00:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:00:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:00:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:00:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:00:28 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:00:28 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:00:28 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Sep 07 14:00:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.250s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:00:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:00:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager._thread_info {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:00:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread count: 28 {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 14:00:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread info: [<_MainThread(MainThread, started 132147689414784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 14:00:29 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=7,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:00:29 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=8,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:00:54 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Flow 'volume_create_manager' (738fff09-a768-4444-b2e7-2ee1c67fb540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3ca2b98-2691-4d97-a202-7c9815c461fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3ca2b98-2691-4d97-a202-7c9815c461fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-414473215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=093a1d6c-d268-4033-9eb4-2c09ec6a469a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c028d87f0198497cadc6b6dd7f76224f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:00:55Z,use_quota=True,user_id='2e65425d083f44f48b21d051e4850669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e4447e3-b508-4dc1-a875-b5b37fa7808f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e4447e3-b508-4dc1-a875-b5b37fa7808f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7729dab2-5089-4ae6-bb1e-d4e629409a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7729dab2-5089-4ae6-bb1e-d4e629409a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '093a1d6c-d268-4033-9eb4-2c09ec6a469a', 'volume_name': 'volume-093a1d6c-d268-4033-9eb4-2c09ec6a469a', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35151b2e-1982-49d3-b5f2-200f9b3f9f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35151b2e-1982-49d3-b5f2-200f9b3f9f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e433985d-26b3-4caa-becd-10d94eb3fd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:00:55 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Volume 093a1d6c-d268-4033-9eb4-2c09ec6a469a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-093a1d6c-d268-4033-9eb4-2c09ec6a469a', 'volume_size': 1} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-414473215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=093a1d6c-d268-4033-9eb4-2c09ec6a469a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c028d87f0198497cadc6b6dd7f76224f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:00:55Z,use_quota=True,user_id='2e65425d083f44f48b21d051e4850669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Creating volume 093a1d6c-d268-4033-9eb4-2c09ec6a469a {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:00:55 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-093a1d6c-d268-4033-9eb4-2c09ec6a469a 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:00:55 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-093a1d6c-d268-4033-9eb4-2c09ec6a469a 1073741824 Sep 07 14:00:55 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:00:55 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-093a1d6c-d268-4033-9eb4-2c09ec6a469a 1073741824" returned: 0 in 0.409s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-093a1d6c-d268-4033-9eb4-2c09ec6a469a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:00:55 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-093a1d6c-d268-4033-9eb4-2c09ec6a469a Sep 07 14:00:55 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:00:55 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-093a1d6c-d268-4033-9eb4-2c09ec6a469a" returned: 0 in 0.242s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e433985d-26b3-4caa-becd-10d94eb3fd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-093a1d6c-d268-4033-9eb4-2c09ec6a469a', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (625d7979-1915-4890-adcb-e517a0f6d9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:00:55 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Volume volume-093a1d6c-d268-4033-9eb4-2c09ec6a469a (093a1d6c-d268-4033-9eb4-2c09ec6a469a): created successfully Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (625d7979-1915-4890-adcb-e517a0f6d9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:00:55 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Flow 'volume_create_manager' (738fff09-a768-4444-b2e7-2ee1c67fb540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:00:55 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-d8990352-ac52-4acf-b9b4-d2725b842afe tempest-TestMinimumBasicScenario-155121175 None] Created volume successfully. Sep 07 14:00:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-a0fe26b4-1e7d-4c01-8542-710092a1661a req-9452ad26-4e6a-480c-a746-0978e7893946 tempest-TestMinimumBasicScenario-155121175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:00:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-a0fe26b4-1e7d-4c01-8542-710092a1661a req-9452ad26-4e6a-480c-a746-0978e7893946 tempest-TestMinimumBasicScenario-155121175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:00:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-a0fe26b4-1e7d-4c01-8542-710092a1661a req-9452ad26-4e6a-480c-a746-0978e7893946 tempest-TestMinimumBasicScenario-155121175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:00:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-a0fe26b4-1e7d-4c01-8542-710092a1661a req-9452ad26-4e6a-480c-a746-0978e7893946 tempest-TestMinimumBasicScenario-155121175 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285', 'name': 'volume-093a1d6c-d268-4033-9eb4-2c09ec6a469a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5cf7339c-c603-4df8-b170-d51c804ebe56', 'enforce_multipath': True} {{(pid=87571) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 14:00:56 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-a0fe26b4-1e7d-4c01-8542-710092a1661a req-9452ad26-4e6a-480c-a746-0978e7893946 tempest-TestMinimumBasicScenario-155121175 None] attachment_update completed successfully. Sep 07 14:01:06 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:01:06 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:UPDATE=7,cinder:SELECT=5 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:01:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:01:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:01:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:01:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:01:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:01:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:01:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:01:28 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:01:28 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:01:28 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Sep 07 14:01:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.242s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:01:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:01:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager._thread_info {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:01:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread count: 28 {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 14:01:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread info: [<_MainThread(MainThread, started 132147689414784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 14:01:42 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-3b161350-dfb2-461c-91da-ee9c69af0d1a req-5f3befec-9abd-44ab-9226-d0fbcb29ea62 tempest-TestMinimumBasicScenario-155121175 None] Terminate volume connection completed successfully. Sep 07 14:01:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-3b161350-dfb2-461c-91da-ee9c69af0d1a req-5f3befec-9abd-44ab-9226-d0fbcb29ea62 tempest-TestMinimumBasicScenario-155121175 None] Deleting attachment 5cf7339c-c603-4df8-b170-d51c804ebe56. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 14:01:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f95fb320-2466-4e84-a606-8ba9df8d9f9a tempest-TestMinimumBasicScenario-155121175 None] Acquiring lock "cinder-093a1d6c-d268-4033-9eb4-2c09ec6a469a-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:01:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f95fb320-2466-4e84-a606-8ba9df8d9f9a tempest-TestMinimumBasicScenario-155121175 None] Lock "cinder-093a1d6c-d268-4033-9eb4-2c09ec6a469a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:01:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f95fb320-2466-4e84-a606-8ba9df8d9f9a tempest-TestMinimumBasicScenario-155121175 None] Acquiring lock "cinder-quobyte-093a1d6c-d268-4033-9eb4-2c09ec6a469a" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:01:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f95fb320-2466-4e84-a606-8ba9df8d9f9a tempest-TestMinimumBasicScenario-155121175 None] Lock "cinder-quobyte-093a1d6c-d268-4033-9eb4-2c09ec6a469a" acquired by "delete_volume" :: waited 0.014s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:01:43 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2887056-4f61-4601-a77f-d0788fe47989]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:01:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f95fb320-2466-4e84-a606-8ba9df8d9f9a tempest-TestMinimumBasicScenario-155121175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-093a1d6c-d268-4033-9eb4-2c09ec6a469a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:01:43 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-093a1d6c-d268-4033-9eb4-2c09ec6a469a Sep 07 14:01:43 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:01:43 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 07 14:01:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f95fb320-2466-4e84-a606-8ba9df8d9f9a tempest-TestMinimumBasicScenario-155121175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-093a1d6c-d268-4033-9eb4-2c09ec6a469a" returned: 0 in 0.335s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:01:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f95fb320-2466-4e84-a606-8ba9df8d9f9a tempest-TestMinimumBasicScenario-155121175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-093a1d6c-d268-4033-9eb4-2c09ec6a469a {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:01:43 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-093a1d6c-d268-4033-9eb4-2c09ec6a469a Sep 07 14:01:43 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:01:44 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Sep 07 14:01:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f95fb320-2466-4e84-a606-8ba9df8d9f9a tempest-TestMinimumBasicScenario-155121175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-093a1d6c-d268-4033-9eb4-2c09ec6a469a" returned: 0 in 0.230s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:01:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f95fb320-2466-4e84-a606-8ba9df8d9f9a tempest-TestMinimumBasicScenario-155121175 None] Lock "cinder-quobyte-093a1d6c-d268-4033-9eb4-2c09ec6a469a" released by "delete_volume" :: held 0.601s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:01:44 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-f95fb320-2466-4e84-a606-8ba9df8d9f9a tempest-TestMinimumBasicScenario-155121175 None] Created reservations ['4058bc2b-6a79-4acb-868e-a8753e5c0e17', '767c33f8-d54d-40ba-9d01-d6f161523d33', '1c04f312-151a-4d6e-a204-f096bcbc38c6', '057613bc-af0f-4df1-a098-8572b7d2fd39'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:01:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f95fb320-2466-4e84-a606-8ba9df8d9f9a tempest-TestMinimumBasicScenario-155121175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:01:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f95fb320-2466-4e84-a606-8ba9df8d9f9a tempest-TestMinimumBasicScenario-155121175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:01:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f95fb320-2466-4e84-a606-8ba9df8d9f9a tempest-TestMinimumBasicScenario-155121175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:01:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f95fb320-2466-4e84-a606-8ba9df8d9f9a tempest-TestMinimumBasicScenario-155121175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:01:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f95fb320-2466-4e84-a606-8ba9df8d9f9a tempest-TestMinimumBasicScenario-155121175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:01:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f95fb320-2466-4e84-a606-8ba9df8d9f9a tempest-TestMinimumBasicScenario-155121175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:01:44 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:01:44 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:01:44 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Sep 07 14:01:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f95fb320-2466-4e84-a606-8ba9df8d9f9a tempest-TestMinimumBasicScenario-155121175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.230s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:01:44 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-f95fb320-2466-4e84-a606-8ba9df8d9f9a tempest-TestMinimumBasicScenario-155121175 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:01:44 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-f95fb320-2466-4e84-a606-8ba9df8d9f9a tempest-TestMinimumBasicScenario-155121175 None] Deleted volume successfully. Sep 07 14:01:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f95fb320-2466-4e84-a606-8ba9df8d9f9a tempest-TestMinimumBasicScenario-155121175 None] Lock "cinder-093a1d6c-d268-4033-9eb4-2c09ec6a469a-delete_volume" released by "delete_volume" :: held 1.011s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:01:54 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=3 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:01:54 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:02:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:02:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:02:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:02:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:02:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:02:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:02:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:28 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:02:28 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:28 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.231s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:02:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager._thread_info {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:02:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread count: 28 {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 14:02:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread info: [<_MainThread(MainThread, started 132147689414784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 14:02:47 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:02:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Flow 'volume_create_manager' (5b72a864-5a3e-454f-94c5-451a2e48e5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:02:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b50235-3c8d-4e4a-81d1-a2e7faafe1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:02:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b50235-3c8d-4e4a-81d1-a2e7faafe1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-156093595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34538ea4-fcd2-40c3-9329-912c9cab08f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fbf5dd9c0874526b274b07fcf9b9246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:02:48Z,use_quota=True,user_id='5a709650a9044b4e824f513ff8d34c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:02:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea6f008-fe22-4ac0-af60-01f5fd7432a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:02:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea6f008-fe22-4ac0-af60-01f5fd7432a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:02:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (878f556e-1192-4bdc-88e4-f81108727a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:02:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (878f556e-1192-4bdc-88e4-f81108727a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34538ea4-fcd2-40c3-9329-912c9cab08f0', 'volume_name': 'volume-34538ea4-fcd2-40c3-9329-912c9cab08f0', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:02:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a3cdf0-bd8b-48dc-af8d-e130a2f61d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:02:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a3cdf0-bd8b-48dc-af8d-e130a2f61d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:02:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c85f931-e68a-44cf-9495-1e43eabc2b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:02:48 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Volume 34538ea4-fcd2-40c3-9329-912c9cab08f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34538ea4-fcd2-40c3-9329-912c9cab08f0', 'volume_size': 1} Sep 07 14:02:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:02:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:02:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-156093595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34538ea4-fcd2-40c3-9329-912c9cab08f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fbf5dd9c0874526b274b07fcf9b9246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:02:48Z,use_quota=True,user_id='5a709650a9044b4e824f513ff8d34c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:02:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Creating volume 34538ea4-fcd2-40c3-9329-912c9cab08f0 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:02:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:02:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:02:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:02:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:02:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:02:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:02:48 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:02:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34538ea4-fcd2-40c3-9329-912c9cab08f0 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:48 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34538ea4-fcd2-40c3-9329-912c9cab08f0 1073741824 Sep 07 14:02:48 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:48 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34538ea4-fcd2-40c3-9329-912c9cab08f0 1073741824" returned: 0 in 0.392s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34538ea4-fcd2-40c3-9329-912c9cab08f0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:48 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34538ea4-fcd2-40c3-9329-912c9cab08f0 Sep 07 14:02:48 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:48 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34538ea4-fcd2-40c3-9329-912c9cab08f0" returned: 0 in 0.235s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:02:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:02:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c85f931-e68a-44cf-9495-1e43eabc2b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34538ea4-fcd2-40c3-9329-912c9cab08f0', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:02:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a942df94-6981-42f2-8249-5366a352c335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:02:48 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Volume volume-34538ea4-fcd2-40c3-9329-912c9cab08f0 (34538ea4-fcd2-40c3-9329-912c9cab08f0): created successfully Sep 07 14:02:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a942df94-6981-42f2-8249-5366a352c335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:02:48 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Flow 'volume_create_manager' (5b72a864-5a3e-454f-94c5-451a2e48e5c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:02:48 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-f0abf705-c911-4c64-aaf5-64bd50f0271a tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Created volume successfully. Sep 07 14:02:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-802d6e3f-240c-452a-b161-6fc448f452fe req-0a30e5b4-c6c6-4eec-a348-d6c517789817 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:02:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-802d6e3f-240c-452a-b161-6fc448f452fe req-0a30e5b4-c6c6-4eec-a348-d6c517789817 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:02:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [req-802d6e3f-240c-452a-b161-6fc448f452fe req-0a30e5b4-c6c6-4eec-a348-d6c517789817 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:02:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-802d6e3f-240c-452a-b161-6fc448f452fe req-0a30e5b4-c6c6-4eec-a348-d6c517789817 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285', 'name': 'volume-34538ea4-fcd2-40c3-9329-912c9cab08f0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '125e2511-b35a-439d-9b0a-7b604fe8b06d', 'enforce_multipath': True} {{(pid=87571) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 14:02:50 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-802d6e3f-240c-452a-b161-6fc448f452fe req-0a30e5b4-c6c6-4eec-a348-d6c517789817 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] attachment_update completed successfully. Sep 07 14:02:51 devstack cinder-volume[87571]: INFO cinder.volume.manager [req-1057f8a6-1d11-4dde-ab78-5e060dabe356 req-cf5e1a6f-8ca7-45a7-9417-0e67b39b8ff5 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Terminate volume connection completed successfully. Sep 07 14:02:51 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [req-1057f8a6-1d11-4dde-ab78-5e060dabe356 req-cf5e1a6f-8ca7-45a7-9417-0e67b39b8ff5 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Deleting attachment 125e2511-b35a-439d-9b0a-7b604fe8b06d. {{(pid=87571) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 14:02:52 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ed0b75aa-8489-4de9-80b9-396d348763f5 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Acquiring lock "cinder-34538ea4-fcd2-40c3-9329-912c9cab08f0-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:02:52 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ed0b75aa-8489-4de9-80b9-396d348763f5 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Lock "cinder-34538ea4-fcd2-40c3-9329-912c9cab08f0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:02:52 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ed0b75aa-8489-4de9-80b9-396d348763f5 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Acquiring lock "cinder-quobyte-34538ea4-fcd2-40c3-9329-912c9cab08f0" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:02:52 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ed0b75aa-8489-4de9-80b9-396d348763f5 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Lock "cinder-quobyte-34538ea4-fcd2-40c3-9329-912c9cab08f0" acquired by "delete_volume" :: waited 0.014s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:02:52 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[286c5c66-3254-4ab9-bff0-83d6adde21e7]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:02:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ed0b75aa-8489-4de9-80b9-396d348763f5 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34538ea4-fcd2-40c3-9329-912c9cab08f0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:52 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34538ea4-fcd2-40c3-9329-912c9cab08f0 Sep 07 14:02:52 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:53 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ed0b75aa-8489-4de9-80b9-396d348763f5 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34538ea4-fcd2-40c3-9329-912c9cab08f0" returned: 0 in 0.365s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ed0b75aa-8489-4de9-80b9-396d348763f5 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34538ea4-fcd2-40c3-9329-912c9cab08f0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:53 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34538ea4-fcd2-40c3-9329-912c9cab08f0 Sep 07 14:02:53 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:53 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ed0b75aa-8489-4de9-80b9-396d348763f5 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-34538ea4-fcd2-40c3-9329-912c9cab08f0" returned: 0 in 0.234s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:53 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ed0b75aa-8489-4de9-80b9-396d348763f5 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Lock "cinder-quobyte-34538ea4-fcd2-40c3-9329-912c9cab08f0" released by "delete_volume" :: held 0.636s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:02:53 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-ed0b75aa-8489-4de9-80b9-396d348763f5 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Created reservations ['b3f6dcc3-e829-4588-b4d5-ef25c5a6cb6d', 'ad8fa866-b517-4ecb-8d3e-8b89834dd74d', '131654a5-be0b-438a-9d20-8737e24283fc', 'f7ad1f85-9025-48c0-9dba-563d39d40092'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:02:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ed0b75aa-8489-4de9-80b9-396d348763f5 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:02:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ed0b75aa-8489-4de9-80b9-396d348763f5 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:02:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ed0b75aa-8489-4de9-80b9-396d348763f5 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:02:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ed0b75aa-8489-4de9-80b9-396d348763f5 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:02:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ed0b75aa-8489-4de9-80b9-396d348763f5 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:02:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ed0b75aa-8489-4de9-80b9-396d348763f5 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:53 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:02:53 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:53 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ed0b75aa-8489-4de9-80b9-396d348763f5 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.239s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:53 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-ed0b75aa-8489-4de9-80b9-396d348763f5 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:02:53 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-ed0b75aa-8489-4de9-80b9-396d348763f5 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Deleted volume successfully. Sep 07 14:02:53 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ed0b75aa-8489-4de9-80b9-396d348763f5 tempest-TestServerVolumeAttachScenarioOldVersion-832004108 None] Lock "cinder-34538ea4-fcd2-40c3-9329-912c9cab08f0-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:03 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:UPDATE=15,cinder:SELECT=14,cinder:INSERT=3 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:03:03 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=16,cinder:INSERT=2,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:03:10 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:03:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Flow 'volume_create_manager' (7f4acce9-8d6c-4f2e-8827-9ba843bc0955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90199af7-07ec-422d-bcb4-cd899f680957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90199af7-07ec-422d-bcb4-cd899f680957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8b368b-8059-4efe-a2cd-25a39dc65b88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db91dee291634286a82e70e8e4ea7da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:11Z,use_quota=True,user_id='ccfe09e583f6440683a94ba6c290eaec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c7cee-7736-41b0-a20d-7e3a322b997a),volume_type_id=432c7cee-7736-41b0-a20d-7e3a322b997a)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc1d789-95cd-430c-8d71-52b6967a4073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc1d789-95cd-430c-8d71-52b6967a4073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:10 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45f6518-f7d2-41ec-9a17-e5875b3e8c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:10 devstack cinder-volume[87571]: DEBUG cinder.image.glance [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Creating Keystone auth plugin from conf {{(pid=87571) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 14:03:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45f6518-f7d2-41ec-9a17-e5875b3e8c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7f8b368b-8059-4efe-a2cd-25a39dc65b88', 'volume_name': 'volume-7f8b368b-8059-4efe-a2cd-25a39dc65b88', 'volume_size': 1, 'image_id': '94c29dff-aef2-4ce4-95f0-f692cde6f148', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94c29dff-aef2-4ce4-95f0-f692cde6f148', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9984363343940b33f3eb7597689bee04', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'db91dee291634286a82e70e8e4ea7da8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd73dee7f7861230e5c3af6f88cfec199d735d0719d91428acb5963dca8d8c2bd97304b3150a1a5b926b18f9f02b3d86d76ca739ac50037e1853adb840979c4a6', 'id': '94c29dff-aef2-4ce4-95f0-f692cde6f148', 'created_at': datetime.datetime(2026, 9, 7, 12, 3, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 12, 3, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94c29dff-aef2-4ce4-95f0-f692cde6f148/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053df835-3032-4f98-b837-6f1a8f89e08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053df835-3032-4f98-b837-6f1a8f89e08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d49a1b-6817-4f93-9a69-b4e5340acdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:11 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Volume 7f8b368b-8059-4efe-a2cd-25a39dc65b88: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7f8b368b-8059-4efe-a2cd-25a39dc65b88', 'volume_size': 1, 'image_id': '94c29dff-aef2-4ce4-95f0-f692cde6f148', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94c29dff-aef2-4ce4-95f0-f692cde6f148', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9984363343940b33f3eb7597689bee04', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'db91dee291634286a82e70e8e4ea7da8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd73dee7f7861230e5c3af6f88cfec199d735d0719d91428acb5963dca8d8c2bd97304b3150a1a5b926b18f9f02b3d86d76ca739ac50037e1853adb840979c4a6', 'id': '94c29dff-aef2-4ce4-95f0-f692cde6f148', 'created_at': datetime.datetime(2026, 9, 7, 12, 3, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 12, 3, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94c29dff-aef2-4ce4-95f0-f692cde6f148/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 07 14:03:11 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Trying to clone 7f8b368b-8059-4efe-a2cd-25a39dc65b88 from image 94c29dff-aef2-4ce4-95f0-f692cde6f148 at location (None, [{'url': 'file:///opt/stack/data/glance/images/94c29dff-aef2-4ce4-95f0-f692cde6f148', 'metadata': {}}]). {{(pid=87571) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1099}} Sep 07 14:03:11 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 14:03:11 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Image download 0.00 MB at 0.00 MB/s Sep 07 14:03:11 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f55ab1-f8da-4089-b66e-0dc8321368ad]: (4, 'raw') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:11 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD Sep 07 14:03:11 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:11 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:11 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD Sep 07 14:03:11 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:11 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:03:11 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Temporary image 94c29dff-aef2-4ce4-95f0-f692cde6f148 is fetched for user ccfe09e583f6440683a94ba6c290eaec. {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 14:03:11 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2fb30e-3005-4f26-b70a-fbe1adc574eb]: (4, 'raw') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:12 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD Sep 07 14:03:12 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:12 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:12 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD Sep 07 14:03:12 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:12 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD" returned: 1 in 0.300s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:03:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8b368b-8059-4efe-a2cd-25a39dc65b88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db91dee291634286a82e70e8e4ea7da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:11Z,use_quota=True,user_id='ccfe09e583f6440683a94ba6c290eaec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(432c7cee-7736-41b0-a20d-7e3a322b997a),volume_type_id=432c7cee-7736-41b0-a20d-7e3a322b997a)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Creating volume 7f8b368b-8059-4efe-a2cd-25a39dc65b88 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:12 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:03:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8b368b-8059-4efe-a2cd-25a39dc65b88 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:12 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8b368b-8059-4efe-a2cd-25a39dc65b88 1073741824 Sep 07 14:03:12 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:13 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8b368b-8059-4efe-a2cd-25a39dc65b88 1073741824" returned: 0 in 0.392s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8b368b-8059-4efe-a2cd-25a39dc65b88 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:13 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8b368b-8059-4efe-a2cd-25a39dc65b88 Sep 07 14:03:13 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:13 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8b368b-8059-4efe-a2cd-25a39dc65b88" returned: 0 in 0.228s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:13 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] <== create_volume: return (665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:13 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Attempting download of 94c29dff-aef2-4ce4-95f0-f692cde6f148 ((None, [{'url': 'file:///opt/stack/data/glance/images/94c29dff-aef2-4ce4-95f0-f692cde6f148', 'metadata': {}}])) to volume 7f8b368b-8059-4efe-a2cd-25a39dc65b88. {{(pid=87571) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 14:03:13 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[197e81f8-8dbc-4324-a17c-306babb1ddc1]: (4, 'raw') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94c29dff-aef2-4ce4-95f0-f692cde6f148_9qa48raw {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:13 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94c29dff-aef2-4ce4-95f0-f692cde6f148_9qa48raw Sep 07 14:03:13 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:13 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94c29dff-aef2-4ce4-95f0-f692cde6f148_9qa48raw" returned: 0 in 0.319s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94c29dff-aef2-4ce4-95f0-f692cde6f148_9qa48raw {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:13 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94c29dff-aef2-4ce4-95f0-f692cde6f148_9qa48raw Sep 07 14:03:13 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:13 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94c29dff-aef2-4ce4-95f0-f692cde6f148_9qa48raw" returned: 1 in 0.329s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94c29dff-aef2-4ce4-95f0-f692cde6f148_9qa48raw' failed. Not Retrying. {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:03:13 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[959e6cd2-6611-4873-be38-13857b036d6c]: (4, 'raw') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:14 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD Sep 07 14:03:14 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:14 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:14 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD Sep 07 14:03:14 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:14 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD" returned: 1 in 0.335s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:03:14 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] 94c29dff-aef2-4ce4-95f0-f692cde6f148 was raw, converting to qcow2 {{(pid=87571) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 14:03:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8b368b-8059-4efe-a2cd-25a39dc65b88 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:14 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8b368b-8059-4efe-a2cd-25a39dc65b88 Sep 07 14:03:14 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:15 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8b368b-8059-4efe-a2cd-25a39dc65b88" returned: 0 in 0.433s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:15 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_94c29dff-aef2-4ce4-95f0-f692cde6f148_c8f8mn5jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8b368b-8059-4efe-a2cd-25a39dc65b88 {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 14:03:15 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 14:03:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8b368b-8059-4efe-a2cd-25a39dc65b88 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:15 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8b368b-8059-4efe-a2cd-25a39dc65b88 1G Sep 07 14:03:15 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:15 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8b368b-8059-4efe-a2cd-25a39dc65b88 1G" returned: 0 in 0.300s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:15 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Downloaded image 94c29dff-aef2-4ce4-95f0-f692cde6f148 ((None, [{'url': 'file:///opt/stack/data/glance/images/94c29dff-aef2-4ce4-95f0-f692cde6f148', 'metadata': {}}])) to volume 7f8b368b-8059-4efe-a2cd-25a39dc65b88 successfully. {{(pid=87571) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 14:03:15 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Temporary image 94c29dff-aef2-4ce4-95f0-f692cde6f148 for user ccfe09e583f6440683a94ba6c290eaec is deleted. {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 14:03:15 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Marking volume 7f8b368b-8059-4efe-a2cd-25a39dc65b88 as bootable. {{(pid=87571) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 14:03:15 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Copying metadata from image 94c29dff-aef2-4ce4-95f0-f692cde6f148 to 7f8b368b-8059-4efe-a2cd-25a39dc65b88. {{(pid=87571) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 14:03:15 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Creating volume glance metadata for volume 7f8b368b-8059-4efe-a2cd-25a39dc65b88 backed by image 94c29dff-aef2-4ce4-95f0-f692cde6f148 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '94c29dff-aef2-4ce4-95f0-f692cde6f148', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '9984363343940b33f3eb7597689bee04', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87571) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 14:03:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d49a1b-6817-4f93-9a69-b4e5340acdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f8b368b-8059-4efe-a2cd-25a39dc65b88', 'volume_size': 1, 'image_id': '94c29dff-aef2-4ce4-95f0-f692cde6f148', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94c29dff-aef2-4ce4-95f0-f692cde6f148', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9984363343940b33f3eb7597689bee04', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'db91dee291634286a82e70e8e4ea7da8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd73dee7f7861230e5c3af6f88cfec199d735d0719d91428acb5963dca8d8c2bd97304b3150a1a5b926b18f9f02b3d86d76ca739ac50037e1853adb840979c4a6', 'id': '94c29dff-aef2-4ce4-95f0-f692cde6f148', 'created_at': datetime.datetime(2026, 9, 7, 12, 3, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 12, 3, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94c29dff-aef2-4ce4-95f0-f692cde6f148/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb84ef28-8d3e-4b19-b2be-e3d6c87c931b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:15 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Volume volume-7f8b368b-8059-4efe-a2cd-25a39dc65b88 (7f8b368b-8059-4efe-a2cd-25a39dc65b88): created successfully Sep 07 14:03:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb84ef28-8d3e-4b19-b2be-e3d6c87c931b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Flow 'volume_create_manager' (7f4acce9-8d6c-4f2e-8827-9ba843bc0955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:15 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-2c7c16ca-c428-4474-8392-230e5d722e67 tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Created volume successfully. Sep 07 14:03:16 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-16d330ab-3d78-4d23-bbb7-8ad96771859d tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Acquiring lock "cinder-7f8b368b-8059-4efe-a2cd-25a39dc65b88-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:16 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-16d330ab-3d78-4d23-bbb7-8ad96771859d tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Lock "cinder-7f8b368b-8059-4efe-a2cd-25a39dc65b88-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:16 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-16d330ab-3d78-4d23-bbb7-8ad96771859d tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Acquiring lock "cinder-quobyte-7f8b368b-8059-4efe-a2cd-25a39dc65b88" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:16 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-16d330ab-3d78-4d23-bbb7-8ad96771859d tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Lock "cinder-quobyte-7f8b368b-8059-4efe-a2cd-25a39dc65b88" acquired by "delete_volume" :: waited 0.013s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:16 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0885ed7-ef14-4eb7-bcfa-a6e86cd3919c]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-16d330ab-3d78-4d23-bbb7-8ad96771859d tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8b368b-8059-4efe-a2cd-25a39dc65b88 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:16 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8b368b-8059-4efe-a2cd-25a39dc65b88 Sep 07 14:03:16 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:16 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-16d330ab-3d78-4d23-bbb7-8ad96771859d tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8b368b-8059-4efe-a2cd-25a39dc65b88" returned: 0 in 0.329s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-16d330ab-3d78-4d23-bbb7-8ad96771859d tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8b368b-8059-4efe-a2cd-25a39dc65b88 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:16 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8b368b-8059-4efe-a2cd-25a39dc65b88 Sep 07 14:03:16 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:16 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-16d330ab-3d78-4d23-bbb7-8ad96771859d tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7f8b368b-8059-4efe-a2cd-25a39dc65b88" returned: 0 in 0.228s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:16 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-16d330ab-3d78-4d23-bbb7-8ad96771859d tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Lock "cinder-quobyte-7f8b368b-8059-4efe-a2cd-25a39dc65b88" released by "delete_volume" :: held 0.593s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:16 devstack cinder-volume[87571]: WARNING cinder.quota [None req-16d330ab-3d78-4d23-bbb7-8ad96771859d tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 07 14:03:16 devstack cinder-volume[87571]: WARNING cinder.quota [None req-16d330ab-3d78-4d23-bbb7-8ad96771859d tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 07 14:03:16 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-16d330ab-3d78-4d23-bbb7-8ad96771859d tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Created reservations ['40a6de89-f761-4e14-b8c4-6e4b185c8593', '0095f851-a889-4017-b648-ccf4a1450461', '90c18113-9b42-49d1-be6a-e21fac05eb93', '75d22795-30c4-43f8-b16f-9a4d208a749a'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:03:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-16d330ab-3d78-4d23-bbb7-8ad96771859d tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-16d330ab-3d78-4d23-bbb7-8ad96771859d tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-16d330ab-3d78-4d23-bbb7-8ad96771859d tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-16d330ab-3d78-4d23-bbb7-8ad96771859d tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-16d330ab-3d78-4d23-bbb7-8ad96771859d tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-16d330ab-3d78-4d23-bbb7-8ad96771859d tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:16 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:03:16 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:17 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-16d330ab-3d78-4d23-bbb7-8ad96771859d tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.236s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:17 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-16d330ab-3d78-4d23-bbb7-8ad96771859d tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:03:17 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-16d330ab-3d78-4d23-bbb7-8ad96771859d tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Deleted volume successfully. Sep 07 14:03:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-16d330ab-3d78-4d23-bbb7-8ad96771859d tempest-VolumeAndVolumeTypeFromImageTest-2006404908 None] Lock "cinder-7f8b368b-8059-4efe-a2cd-25a39dc65b88-delete_volume" released by "delete_volume" :: held 1.006s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Flow 'volume_create_manager' (4fac6523-1d8d-4254-98b6-7fcfbf538728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661e99b9-9788-4061-b417-1ea50067995f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661e99b9-9788-4061-b417-1ea50067995f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2005056845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99347698-befa-47bb-a950-1a188f86888f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7cb91da5674bc5812f22bd37e8c28c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:21Z,use_quota=True,user_id='748d3599a11c434386ba75fd805eac36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b5f7c7-a852-4870-8222-b5f02280982e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b5f7c7-a852-4870-8222-b5f02280982e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec01b45-35d7-4401-8ef8-2bec87431ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec01b45-35d7-4401-8ef8-2bec87431ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99347698-befa-47bb-a950-1a188f86888f', 'volume_name': 'volume-99347698-befa-47bb-a950-1a188f86888f', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a732f7-76fc-43aa-aae1-61e77c70ff6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a732f7-76fc-43aa-aae1-61e77c70ff6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a39efe-e1ec-4d4a-b59b-7b98b7fc8cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:21 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Volume 99347698-befa-47bb-a950-1a188f86888f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99347698-befa-47bb-a950-1a188f86888f', 'volume_size': 1} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2005056845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99347698-befa-47bb-a950-1a188f86888f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7cb91da5674bc5812f22bd37e8c28c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:21Z,use_quota=True,user_id='748d3599a11c434386ba75fd805eac36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Creating volume 99347698-befa-47bb-a950-1a188f86888f {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:21 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-99347698-befa-47bb-a950-1a188f86888f 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:21 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-99347698-befa-47bb-a950-1a188f86888f 1073741824 Sep 07 14:03:21 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Flow 'volume_create_manager' (fcc43275-f584-44bf-948e-8649f2a2fd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (992cf44a-d0f4-4e22-b896-e90870deca91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (992cf44a-d0f4-4e22-b896-e90870deca91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1068335991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4395c7-5967-4992-b569-280e1926a4a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7cb91da5674bc5812f22bd37e8c28c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:22Z,use_quota=True,user_id='748d3599a11c434386ba75fd805eac36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (828b8d84-7ded-4c10-a565-6efbb87c3422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (828b8d84-7ded-4c10-a565-6efbb87c3422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f39bd836-30c9-4404-8ae0-af219129a8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f39bd836-30c9-4404-8ae0-af219129a8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb4395c7-5967-4992-b569-280e1926a4a5', 'volume_name': 'volume-cb4395c7-5967-4992-b569-280e1926a4a5', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf33043-a8ee-4090-8140-e6e2f0fcf472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf33043-a8ee-4090-8140-e6e2f0fcf472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9654f692-0d5a-450e-876d-ec2abe4c55bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:21 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Volume cb4395c7-5967-4992-b569-280e1926a4a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb4395c7-5967-4992-b569-280e1926a4a5', 'volume_size': 1} Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:21 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-99347698-befa-47bb-a950-1a188f86888f 1073741824" returned: 0 in 0.491s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-99347698-befa-47bb-a950-1a188f86888f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:22 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-99347698-befa-47bb-a950-1a188f86888f Sep 07 14:03:22 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Flow 'volume_create_manager' (f892df5f-73b9-495e-8e34-8716b12c7384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f6a7e8-d1f0-492a-96dc-0bb1cc9402b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f6a7e8-d1f0-492a-96dc-0bb1cc9402b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1343013725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e407e9-5162-483a-9d72-e8f8242ddd55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7cb91da5674bc5812f22bd37e8c28c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:22Z,use_quota=True,user_id='748d3599a11c434386ba75fd805eac36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec2b7a2-e368-4a9e-abc6-1b5fc862d8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec2b7a2-e368-4a9e-abc6-1b5fc862d8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d3dacb-a623-4da9-8b39-1f9cc5b52173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d3dacb-a623-4da9-8b39-1f9cc5b52173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24e407e9-5162-483a-9d72-e8f8242ddd55', 'volume_name': 'volume-24e407e9-5162-483a-9d72-e8f8242ddd55', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc1d5a4-64bd-4eb6-a9cc-b84d41b87a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc1d5a4-64bd-4eb6-a9cc-b84d41b87a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32827660-328b-466d-ad6c-69279d7940a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:22 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Volume 24e407e9-5162-483a-9d72-e8f8242ddd55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24e407e9-5162-483a-9d72-e8f8242ddd55', 'volume_size': 1} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:22 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-99347698-befa-47bb-a950-1a188f86888f" returned: 0 in 0.281s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.437s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1068335991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4395c7-5967-4992-b569-280e1926a4a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7cb91da5674bc5812f22bd37e8c28c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:22Z,use_quota=True,user_id='748d3599a11c434386ba75fd805eac36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Creating volume cb4395c7-5967-4992-b569-280e1926a4a5 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:22 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cb4395c7-5967-4992-b569-280e1926a4a5 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a39efe-e1ec-4d4a-b59b-7b98b7fc8cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99347698-befa-47bb-a950-1a188f86888f', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:22 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cb4395c7-5967-4992-b569-280e1926a4a5 1073741824 Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95cc4887-53ae-40b1-bb08-7b2ae94ea4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:22 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:22 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Volume volume-99347698-befa-47bb-a950-1a188f86888f (99347698-befa-47bb-a950-1a188f86888f): created successfully Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95cc4887-53ae-40b1-bb08-7b2ae94ea4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Flow 'volume_create_manager' (4fac6523-1d8d-4254-98b6-7fcfbf538728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:22 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-f1bc2fa9-53a4-4267-9bda-f99781d94b00 tempest-CreateVolumesFromImageTest-1049992771 None] Created volume successfully. Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Flow 'volume_create_manager' (7b82aa62-7bfd-4dfd-a993-3dd41874afc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad9555e6-80a4-4523-8d31-d0ce8b140cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad9555e6-80a4-4523-8d31-d0ce8b140cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1074887258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f686b601-6c42-4337-a361-8f1fca95fc87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7cb91da5674bc5812f22bd37e8c28c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:22Z,use_quota=True,user_id='748d3599a11c434386ba75fd805eac36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384ffb0f-79d5-4ca6-bf45-6beb17a3bec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384ffb0f-79d5-4ca6-bf45-6beb17a3bec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f4ac5ab-e6d6-4b88-88c6-ae0380804494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f4ac5ab-e6d6-4b88-88c6-ae0380804494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f686b601-6c42-4337-a361-8f1fca95fc87', 'volume_name': 'volume-f686b601-6c42-4337-a361-8f1fca95fc87', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67e5197-e6fc-4d70-93e0-7ea3dfd51e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67e5197-e6fc-4d70-93e0-7ea3dfd51e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c89a2e-2314-45e2-adac-32dba0e608fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:22 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Volume f686b601-6c42-4337-a361-8f1fca95fc87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f686b601-6c42-4337-a361-8f1fca95fc87', 'volume_size': 1} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:22 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cb4395c7-5967-4992-b569-280e1926a4a5 1073741824" returned: 0 in 0.502s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cb4395c7-5967-4992-b569-280e1926a4a5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:22 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cb4395c7-5967-4992-b569-280e1926a4a5 Sep 07 14:03:22 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Flow 'volume_create_manager' (6d24dadd-a05c-4441-94fc-429bfaaf6303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5111004-67db-4553-8d84-d25e1613389d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5111004-67db-4553-8d84-d25e1613389d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-534429204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad42346-6024-405c-86fc-7a60b60dd39e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7cb91da5674bc5812f22bd37e8c28c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:23Z,use_quota=True,user_id='748d3599a11c434386ba75fd805eac36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9595e93-c388-4913-9b45-faa9d401bf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9595e93-c388-4913-9b45-faa9d401bf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59822d9a-a882-4873-ba45-5b2436287d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59822d9a-a882-4873-ba45-5b2436287d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ad42346-6024-405c-86fc-7a60b60dd39e', 'volume_name': 'volume-9ad42346-6024-405c-86fc-7a60b60dd39e', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbaebb32-7730-484d-94e9-543890fb30f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbaebb32-7730-484d-94e9-543890fb30f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d6b978-cf37-41fc-bc80-49d0591fe4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:23 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Volume 9ad42346-6024-405c-86fc-7a60b60dd39e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ad42346-6024-405c-86fc-7a60b60dd39e', 'volume_size': 1} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:23 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cb4395c7-5967-4992-b569-280e1926a4a5" returned: 0 in 0.257s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.867s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1343013725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e407e9-5162-483a-9d72-e8f8242ddd55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7cb91da5674bc5812f22bd37e8c28c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:22Z,use_quota=True,user_id='748d3599a11c434386ba75fd805eac36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Creating volume 24e407e9-5162-483a-9d72-e8f8242ddd55 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:23 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-24e407e9-5162-483a-9d72-e8f8242ddd55 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9654f692-0d5a-450e-876d-ec2abe4c55bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb4395c7-5967-4992-b569-280e1926a4a5', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:23 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-24e407e9-5162-483a-9d72-e8f8242ddd55 1073741824 Sep 07 14:03:23 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c4578c-af1f-40c3-8295-ab1d4dce9bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:23 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Volume volume-cb4395c7-5967-4992-b569-280e1926a4a5 (cb4395c7-5967-4992-b569-280e1926a4a5): created successfully Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c4578c-af1f-40c3-8295-ab1d4dce9bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Flow 'volume_create_manager' (fcc43275-f584-44bf-948e-8649f2a2fd73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:23 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-fbb5a6b7-9f73-4ba2-b2cb-5d3080d886bc tempest-CreateVolumesFromImageTest-1049992771 None] Created volume successfully. Sep 07 14:03:23 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-24e407e9-5162-483a-9d72-e8f8242ddd55 1073741824" returned: 0 in 0.393s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-24e407e9-5162-483a-9d72-e8f8242ddd55 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:23 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-24e407e9-5162-483a-9d72-e8f8242ddd55 Sep 07 14:03:23 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:23 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-24e407e9-5162-483a-9d72-e8f8242ddd55" returned: 0 in 0.245s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.175s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1074887258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f686b601-6c42-4337-a361-8f1fca95fc87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7cb91da5674bc5812f22bd37e8c28c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:22Z,use_quota=True,user_id='748d3599a11c434386ba75fd805eac36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Creating volume f686b601-6c42-4337-a361-8f1fca95fc87 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:23 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f686b601-6c42-4337-a361-8f1fca95fc87 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32827660-328b-466d-ad6c-69279d7940a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24e407e9-5162-483a-9d72-e8f8242ddd55', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:23 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f686b601-6c42-4337-a361-8f1fca95fc87 1073741824 Sep 07 14:03:23 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fe164b0-ba9e-4772-bd11-3e5dcb7b78da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:23 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Volume volume-24e407e9-5162-483a-9d72-e8f8242ddd55 (24e407e9-5162-483a-9d72-e8f8242ddd55): created successfully Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fe164b0-ba9e-4772-bd11-3e5dcb7b78da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Flow 'volume_create_manager' (f892df5f-73b9-495e-8e34-8716b12c7384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:23 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-1833a6e0-a74c-4393-9a19-378572dcb35d tempest-CreateVolumesFromImageTest-1049992771 None] Created volume successfully. Sep 07 14:03:24 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f686b601-6c42-4337-a361-8f1fca95fc87 1073741824" returned: 0 in 0.412s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f686b601-6c42-4337-a361-8f1fca95fc87 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:24 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f686b601-6c42-4337-a361-8f1fca95fc87 Sep 07 14:03:24 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:24 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f686b601-6c42-4337-a361-8f1fca95fc87" returned: 0 in 0.230s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.463s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-534429204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad42346-6024-405c-86fc-7a60b60dd39e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7cb91da5674bc5812f22bd37e8c28c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:23Z,use_quota=True,user_id='748d3599a11c434386ba75fd805eac36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Creating volume 9ad42346-6024-405c-86fc-7a60b60dd39e {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:24 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:03:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9ad42346-6024-405c-86fc-7a60b60dd39e 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c89a2e-2314-45e2-adac-32dba0e608fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f686b601-6c42-4337-a361-8f1fca95fc87', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:24 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9ad42346-6024-405c-86fc-7a60b60dd39e 1073741824 Sep 07 14:03:24 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5adb7a-e9e1-4b8e-927a-576720563037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:24 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Volume volume-f686b601-6c42-4337-a361-8f1fca95fc87 (f686b601-6c42-4337-a361-8f1fca95fc87): created successfully Sep 07 14:03:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5adb7a-e9e1-4b8e-927a-576720563037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:24 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Flow 'volume_create_manager' (7b82aa62-7bfd-4dfd-a993-3dd41874afc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:24 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-4a277729-aa1a-4d67-bdbc-9f5eb27d376b tempest-CreateVolumesFromImageTest-1049992771 None] Created volume successfully. Sep 07 14:03:24 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9ad42346-6024-405c-86fc-7a60b60dd39e 1073741824" returned: 0 in 0.421s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9ad42346-6024-405c-86fc-7a60b60dd39e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:24 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9ad42346-6024-405c-86fc-7a60b60dd39e Sep 07 14:03:24 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:25 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9ad42346-6024-405c-86fc-7a60b60dd39e" returned: 0 in 0.244s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d6b978-cf37-41fc-bc80-49d0591fe4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ad42346-6024-405c-86fc-7a60b60dd39e', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abfa2184-b1d3-4bfb-ab3b-033259f39be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:25 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Volume volume-9ad42346-6024-405c-86fc-7a60b60dd39e (9ad42346-6024-405c-86fc-7a60b60dd39e): created successfully Sep 07 14:03:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abfa2184-b1d3-4bfb-ab3b-033259f39be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Flow 'volume_create_manager' (6d24dadd-a05c-4441-94fc-429bfaaf6303) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:25 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-1449e10d-2d1c-40eb-b166-4d5501183953 tempest-CreateVolumesFromImageTest-1049992771 None] Created volume successfully. Sep 07 14:03:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-983b5ee2-c8fc-4cf2-aa6a-7dff37073ab6 tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "cinder-9ad42346-6024-405c-86fc-7a60b60dd39e-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-983b5ee2-c8fc-4cf2-aa6a-7dff37073ab6 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "cinder-9ad42346-6024-405c-86fc-7a60b60dd39e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-983b5ee2-c8fc-4cf2-aa6a-7dff37073ab6 tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "cinder-quobyte-9ad42346-6024-405c-86fc-7a60b60dd39e" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-983b5ee2-c8fc-4cf2-aa6a-7dff37073ab6 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "cinder-quobyte-9ad42346-6024-405c-86fc-7a60b60dd39e" acquired by "delete_volume" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:26 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[632b5679-4a1d-4f6c-8a9d-6299f6cbf77a]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-983b5ee2-c8fc-4cf2-aa6a-7dff37073ab6 tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9ad42346-6024-405c-86fc-7a60b60dd39e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:26 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9ad42346-6024-405c-86fc-7a60b60dd39e Sep 07 14:03:26 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:26 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-983b5ee2-c8fc-4cf2-aa6a-7dff37073ab6 tempest-CreateVolumesFromImageTest-1049992771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9ad42346-6024-405c-86fc-7a60b60dd39e" returned: 0 in 0.339s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-983b5ee2-c8fc-4cf2-aa6a-7dff37073ab6 tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9ad42346-6024-405c-86fc-7a60b60dd39e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:26 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9ad42346-6024-405c-86fc-7a60b60dd39e Sep 07 14:03:26 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:26 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-983b5ee2-c8fc-4cf2-aa6a-7dff37073ab6 tempest-CreateVolumesFromImageTest-1049992771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9ad42346-6024-405c-86fc-7a60b60dd39e" returned: 0 in 0.231s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-983b5ee2-c8fc-4cf2-aa6a-7dff37073ab6 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "cinder-quobyte-9ad42346-6024-405c-86fc-7a60b60dd39e" released by "delete_volume" :: held 0.609s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:27 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-983b5ee2-c8fc-4cf2-aa6a-7dff37073ab6 tempest-CreateVolumesFromImageTest-1049992771 None] Created reservations ['231ff2fa-f122-463c-8d00-6ed04d0743f8', '89782498-b975-4b43-8f9f-e1a2bd4be34a', 'b44d9f0d-768c-460a-95c1-1c19f4ee649b', '198fe382-f7dd-4b6c-bbbe-bc2b61742020'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:03:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-983b5ee2-c8fc-4cf2-aa6a-7dff37073ab6 tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-983b5ee2-c8fc-4cf2-aa6a-7dff37073ab6 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:27 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-983b5ee2-c8fc-4cf2-aa6a-7dff37073ab6 tempest-CreateVolumesFromImageTest-1049992771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:27 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-983b5ee2-c8fc-4cf2-aa6a-7dff37073ab6 tempest-CreateVolumesFromImageTest-1049992771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-983b5ee2-c8fc-4cf2-aa6a-7dff37073ab6 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-983b5ee2-c8fc-4cf2-aa6a-7dff37073ab6 tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:27 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:03:27 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:27 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-983b5ee2-c8fc-4cf2-aa6a-7dff37073ab6 tempest-CreateVolumesFromImageTest-1049992771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.231s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:27 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-983b5ee2-c8fc-4cf2-aa6a-7dff37073ab6 tempest-CreateVolumesFromImageTest-1049992771 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:03:27 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-983b5ee2-c8fc-4cf2-aa6a-7dff37073ab6 tempest-CreateVolumesFromImageTest-1049992771 None] Deleted volume successfully. Sep 07 14:03:27 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-983b5ee2-c8fc-4cf2-aa6a-7dff37073ab6 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "cinder-9ad42346-6024-405c-86fc-7a60b60dd39e-delete_volume" released by "delete_volume" :: held 1.024s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:27 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-59cdde3a-e1e8-469f-aa12-4b024bd177be tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "cinder-f686b601-6c42-4337-a361-8f1fca95fc87-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:27 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-59cdde3a-e1e8-469f-aa12-4b024bd177be tempest-CreateVolumesFromImageTest-1049992771 None] Lock "cinder-f686b601-6c42-4337-a361-8f1fca95fc87-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:27 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-59cdde3a-e1e8-469f-aa12-4b024bd177be tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "cinder-quobyte-f686b601-6c42-4337-a361-8f1fca95fc87" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:27 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-59cdde3a-e1e8-469f-aa12-4b024bd177be tempest-CreateVolumesFromImageTest-1049992771 None] Lock "cinder-quobyte-f686b601-6c42-4337-a361-8f1fca95fc87" acquired by "delete_volume" :: waited 0.013s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:27 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c6200d-1351-4a1f-91df-0cc4abf973fa]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-59cdde3a-e1e8-469f-aa12-4b024bd177be tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f686b601-6c42-4337-a361-8f1fca95fc87 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:27 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f686b601-6c42-4337-a361-8f1fca95fc87 Sep 07 14:03:27 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:27 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-59cdde3a-e1e8-469f-aa12-4b024bd177be tempest-CreateVolumesFromImageTest-1049992771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f686b601-6c42-4337-a361-8f1fca95fc87" returned: 0 in 0.350s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-59cdde3a-e1e8-469f-aa12-4b024bd177be tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f686b601-6c42-4337-a361-8f1fca95fc87 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:27 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f686b601-6c42-4337-a361-8f1fca95fc87 Sep 07 14:03:27 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:28 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-59cdde3a-e1e8-469f-aa12-4b024bd177be tempest-CreateVolumesFromImageTest-1049992771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f686b601-6c42-4337-a361-8f1fca95fc87" returned: 0 in 0.237s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-59cdde3a-e1e8-469f-aa12-4b024bd177be tempest-CreateVolumesFromImageTest-1049992771 None] Lock "cinder-quobyte-f686b601-6c42-4337-a361-8f1fca95fc87" released by "delete_volume" :: held 0.623s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-59cdde3a-e1e8-469f-aa12-4b024bd177be tempest-CreateVolumesFromImageTest-1049992771 None] Created reservations ['a492d2e2-7caa-4137-8d88-94109b76a588', 'dbd181c3-72f9-4f4c-bec7-216958aed158', '37b05551-e704-4de2-a01b-64f2fb59215d', '029a3295-b9a2-4b43-8b05-2c0436e49a90'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-59cdde3a-e1e8-469f-aa12-4b024bd177be tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-59cdde3a-e1e8-469f-aa12-4b024bd177be tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-59cdde3a-e1e8-469f-aa12-4b024bd177be tempest-CreateVolumesFromImageTest-1049992771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-59cdde3a-e1e8-469f-aa12-4b024bd177be tempest-CreateVolumesFromImageTest-1049992771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-59cdde3a-e1e8-469f-aa12-4b024bd177be tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-59cdde3a-e1e8-469f-aa12-4b024bd177be tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:28 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:03:28 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:28 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:03:28 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:28 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-59cdde3a-e1e8-469f-aa12-4b024bd177be tempest-CreateVolumesFromImageTest-1049992771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.256s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-59cdde3a-e1e8-469f-aa12-4b024bd177be tempest-CreateVolumesFromImageTest-1049992771 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:03:28 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-59cdde3a-e1e8-469f-aa12-4b024bd177be tempest-CreateVolumesFromImageTest-1049992771 None] Deleted volume successfully. Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-59cdde3a-e1e8-469f-aa12-4b024bd177be tempest-CreateVolumesFromImageTest-1049992771 None] Lock "cinder-f686b601-6c42-4337-a361-8f1fca95fc87-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:28 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.258s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager._thread_info {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread count: 28 {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread info: [<_MainThread(MainThread, started 132147689414784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c1559f3e-d6bf-4b5e-a7f9-ef9c3ddf7ac3 tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "cinder-24e407e9-5162-483a-9d72-e8f8242ddd55-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c1559f3e-d6bf-4b5e-a7f9-ef9c3ddf7ac3 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "cinder-24e407e9-5162-483a-9d72-e8f8242ddd55-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c1559f3e-d6bf-4b5e-a7f9-ef9c3ddf7ac3 tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "cinder-quobyte-24e407e9-5162-483a-9d72-e8f8242ddd55" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c1559f3e-d6bf-4b5e-a7f9-ef9c3ddf7ac3 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "cinder-quobyte-24e407e9-5162-483a-9d72-e8f8242ddd55" acquired by "delete_volume" :: waited 0.015s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[920c3218-8c4f-4418-8a8f-ee6a1ca7e69c]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c1559f3e-d6bf-4b5e-a7f9-ef9c3ddf7ac3 tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-24e407e9-5162-483a-9d72-e8f8242ddd55 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:28 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-24e407e9-5162-483a-9d72-e8f8242ddd55 Sep 07 14:03:28 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:29 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c1559f3e-d6bf-4b5e-a7f9-ef9c3ddf7ac3 tempest-CreateVolumesFromImageTest-1049992771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-24e407e9-5162-483a-9d72-e8f8242ddd55" returned: 0 in 0.338s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c1559f3e-d6bf-4b5e-a7f9-ef9c3ddf7ac3 tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-24e407e9-5162-483a-9d72-e8f8242ddd55 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:29 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-24e407e9-5162-483a-9d72-e8f8242ddd55 Sep 07 14:03:29 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:29 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c1559f3e-d6bf-4b5e-a7f9-ef9c3ddf7ac3 tempest-CreateVolumesFromImageTest-1049992771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-24e407e9-5162-483a-9d72-e8f8242ddd55" returned: 0 in 0.259s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c1559f3e-d6bf-4b5e-a7f9-ef9c3ddf7ac3 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "cinder-quobyte-24e407e9-5162-483a-9d72-e8f8242ddd55" released by "delete_volume" :: held 0.634s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:29 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-c1559f3e-d6bf-4b5e-a7f9-ef9c3ddf7ac3 tempest-CreateVolumesFromImageTest-1049992771 None] Created reservations ['32a5aee6-cdcc-494e-b353-a1f4b113d447', 'b4d781e1-9b6a-443b-8651-8f6cc17da643', '0a770922-7cba-44ca-b8c7-2ce855d2ab82', '375cb24a-0ae2-4109-94a8-e0586449d91e'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:03:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c1559f3e-d6bf-4b5e-a7f9-ef9c3ddf7ac3 tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c1559f3e-d6bf-4b5e-a7f9-ef9c3ddf7ac3 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c1559f3e-d6bf-4b5e-a7f9-ef9c3ddf7ac3 tempest-CreateVolumesFromImageTest-1049992771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c1559f3e-d6bf-4b5e-a7f9-ef9c3ddf7ac3 tempest-CreateVolumesFromImageTest-1049992771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c1559f3e-d6bf-4b5e-a7f9-ef9c3ddf7ac3 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c1559f3e-d6bf-4b5e-a7f9-ef9c3ddf7ac3 tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:29 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:03:29 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:29 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c1559f3e-d6bf-4b5e-a7f9-ef9c3ddf7ac3 tempest-CreateVolumesFromImageTest-1049992771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.236s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:29 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-c1559f3e-d6bf-4b5e-a7f9-ef9c3ddf7ac3 tempest-CreateVolumesFromImageTest-1049992771 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:03:29 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c1559f3e-d6bf-4b5e-a7f9-ef9c3ddf7ac3 tempest-CreateVolumesFromImageTest-1049992771 None] Deleted volume successfully. Sep 07 14:03:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c1559f3e-d6bf-4b5e-a7f9-ef9c3ddf7ac3 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "cinder-24e407e9-5162-483a-9d72-e8f8242ddd55-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a07e74ea-367a-43a6-92a6-c43f93cefd14 tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "cinder-cb4395c7-5967-4992-b569-280e1926a4a5-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a07e74ea-367a-43a6-92a6-c43f93cefd14 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "cinder-cb4395c7-5967-4992-b569-280e1926a4a5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a07e74ea-367a-43a6-92a6-c43f93cefd14 tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "cinder-quobyte-cb4395c7-5967-4992-b569-280e1926a4a5" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a07e74ea-367a-43a6-92a6-c43f93cefd14 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "cinder-quobyte-cb4395c7-5967-4992-b569-280e1926a4a5" acquired by "delete_volume" :: waited 0.013s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:29 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8a7a24-817b-4797-8e35-db8a20dbe457]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a07e74ea-367a-43a6-92a6-c43f93cefd14 tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cb4395c7-5967-4992-b569-280e1926a4a5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:29 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cb4395c7-5967-4992-b569-280e1926a4a5 Sep 07 14:03:29 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:30 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a07e74ea-367a-43a6-92a6-c43f93cefd14 tempest-CreateVolumesFromImageTest-1049992771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cb4395c7-5967-4992-b569-280e1926a4a5" returned: 0 in 0.369s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a07e74ea-367a-43a6-92a6-c43f93cefd14 tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cb4395c7-5967-4992-b569-280e1926a4a5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:30 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cb4395c7-5967-4992-b569-280e1926a4a5 Sep 07 14:03:30 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:30 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a07e74ea-367a-43a6-92a6-c43f93cefd14 tempest-CreateVolumesFromImageTest-1049992771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cb4395c7-5967-4992-b569-280e1926a4a5" returned: 0 in 0.258s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a07e74ea-367a-43a6-92a6-c43f93cefd14 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "cinder-quobyte-cb4395c7-5967-4992-b569-280e1926a4a5" released by "delete_volume" :: held 0.665s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:30 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-a07e74ea-367a-43a6-92a6-c43f93cefd14 tempest-CreateVolumesFromImageTest-1049992771 None] Created reservations ['2798799f-e42a-4a4c-be65-36037db71d09', '23f860ca-7800-4611-bc5e-47111d5d386f', '9fe23e4e-8f34-40c7-88d2-1c9e672a3396', '4255be99-8b5f-4654-aa19-5e781ff25daf'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:03:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a07e74ea-367a-43a6-92a6-c43f93cefd14 tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a07e74ea-367a-43a6-92a6-c43f93cefd14 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a07e74ea-367a-43a6-92a6-c43f93cefd14 tempest-CreateVolumesFromImageTest-1049992771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a07e74ea-367a-43a6-92a6-c43f93cefd14 tempest-CreateVolumesFromImageTest-1049992771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a07e74ea-367a-43a6-92a6-c43f93cefd14 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a07e74ea-367a-43a6-92a6-c43f93cefd14 tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:30 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:03:30 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:30 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a07e74ea-367a-43a6-92a6-c43f93cefd14 tempest-CreateVolumesFromImageTest-1049992771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.265s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:30 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-a07e74ea-367a-43a6-92a6-c43f93cefd14 tempest-CreateVolumesFromImageTest-1049992771 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:03:30 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-a07e74ea-367a-43a6-92a6-c43f93cefd14 tempest-CreateVolumesFromImageTest-1049992771 None] Deleted volume successfully. Sep 07 14:03:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a07e74ea-367a-43a6-92a6-c43f93cefd14 tempest-CreateVolumesFromImageTest-1049992771 None] Lock "cinder-cb4395c7-5967-4992-b569-280e1926a4a5-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-402c0f00-ed9b-4e47-98eb-12692460e16e tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "cinder-99347698-befa-47bb-a950-1a188f86888f-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-402c0f00-ed9b-4e47-98eb-12692460e16e tempest-CreateVolumesFromImageTest-1049992771 None] Lock "cinder-99347698-befa-47bb-a950-1a188f86888f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-402c0f00-ed9b-4e47-98eb-12692460e16e tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "cinder-quobyte-99347698-befa-47bb-a950-1a188f86888f" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:31 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-402c0f00-ed9b-4e47-98eb-12692460e16e tempest-CreateVolumesFromImageTest-1049992771 None] Lock "cinder-quobyte-99347698-befa-47bb-a950-1a188f86888f" acquired by "delete_volume" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:31 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6511e7-27cc-447d-a5e7-6f9addcb92da]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-402c0f00-ed9b-4e47-98eb-12692460e16e tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-99347698-befa-47bb-a950-1a188f86888f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:31 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-99347698-befa-47bb-a950-1a188f86888f Sep 07 14:03:31 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:31 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-402c0f00-ed9b-4e47-98eb-12692460e16e tempest-CreateVolumesFromImageTest-1049992771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-99347698-befa-47bb-a950-1a188f86888f" returned: 0 in 0.349s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-402c0f00-ed9b-4e47-98eb-12692460e16e tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-99347698-befa-47bb-a950-1a188f86888f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:31 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-99347698-befa-47bb-a950-1a188f86888f Sep 07 14:03:31 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:31 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-402c0f00-ed9b-4e47-98eb-12692460e16e tempest-CreateVolumesFromImageTest-1049992771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-99347698-befa-47bb-a950-1a188f86888f" returned: 0 in 0.241s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:31 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-402c0f00-ed9b-4e47-98eb-12692460e16e tempest-CreateVolumesFromImageTest-1049992771 None] Lock "cinder-quobyte-99347698-befa-47bb-a950-1a188f86888f" released by "delete_volume" :: held 0.628s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:31 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-402c0f00-ed9b-4e47-98eb-12692460e16e tempest-CreateVolumesFromImageTest-1049992771 None] Created reservations ['c6fcada4-a9d9-4dda-b0a9-f28689965c6e', '842a7418-9043-4816-ac8b-8463f40107bb', '968292b4-dc12-4afb-96ac-d3d628e5351b', 'd7f7af4a-d7e6-40f0-a3e0-605945374217'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:03:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-402c0f00-ed9b-4e47-98eb-12692460e16e tempest-CreateVolumesFromImageTest-1049992771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-402c0f00-ed9b-4e47-98eb-12692460e16e tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-402c0f00-ed9b-4e47-98eb-12692460e16e tempest-CreateVolumesFromImageTest-1049992771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-402c0f00-ed9b-4e47-98eb-12692460e16e tempest-CreateVolumesFromImageTest-1049992771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-402c0f00-ed9b-4e47-98eb-12692460e16e tempest-CreateVolumesFromImageTest-1049992771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-402c0f00-ed9b-4e47-98eb-12692460e16e tempest-CreateVolumesFromImageTest-1049992771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:31 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:03:31 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:31 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-402c0f00-ed9b-4e47-98eb-12692460e16e tempest-CreateVolumesFromImageTest-1049992771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.231s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:31 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-402c0f00-ed9b-4e47-98eb-12692460e16e tempest-CreateVolumesFromImageTest-1049992771 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:03:31 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-402c0f00-ed9b-4e47-98eb-12692460e16e tempest-CreateVolumesFromImageTest-1049992771 None] Deleted volume successfully. Sep 07 14:03:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-402c0f00-ed9b-4e47-98eb-12692460e16e tempest-CreateVolumesFromImageTest-1049992771 None] Lock "cinder-99347698-befa-47bb-a950-1a188f86888f-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:34 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:03:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Flow 'volume_create_manager' (003b132b-c9c5-48f5-ad0e-5a5690533962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (711f83f3-b93c-4234-8c81-2f78452c9eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (711f83f3-b93c-4234-8c81-2f78452c9eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1661173805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fce6789-b9ef-48bd-abea-bf54d8044e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f7da0bbe2a42c28a57aa46af48827b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:35Z,use_quota=True,user_id='b22019cf84304eb698ff05b8867fafd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17178c26-c2fa-4f39-b3fa-24c87ab830ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17178c26-c2fa-4f39-b3fa-24c87ab830ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ec55c3-5260-4035-b52c-345e8bc5bf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ec55c3-5260-4035-b52c-345e8bc5bf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fce6789-b9ef-48bd-abea-bf54d8044e9e', 'volume_name': 'volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c062a3de-2f1d-41db-b576-de5476878b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c062a3de-2f1d-41db-b576-de5476878b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258fab09-bd0f-46eb-bc7d-c602c32a0826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:34 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Volume 4fce6789-b9ef-48bd-abea-bf54d8044e9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e', 'volume_size': 1} Sep 07 14:03:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1661173805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fce6789-b9ef-48bd-abea-bf54d8044e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f7da0bbe2a42c28a57aa46af48827b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:35Z,use_quota=True,user_id='b22019cf84304eb698ff05b8867fafd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Creating volume 4fce6789-b9ef-48bd-abea-bf54d8044e9e {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:34 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:03:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:34 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e 1073741824 Sep 07 14:03:34 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:35 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e 1073741824" returned: 0 in 0.393s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:35 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e Sep 07 14:03:35 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:35 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e" returned: 0 in 0.238s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:35 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:35 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258fab09-bd0f-46eb-bc7d-c602c32a0826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:35 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bfe4a89-fd03-43c1-9379-1ae0bab286f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:35 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Volume volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e (4fce6789-b9ef-48bd-abea-bf54d8044e9e): created successfully Sep 07 14:03:35 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bfe4a89-fd03-43c1-9379-1ae0bab286f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:35 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Flow 'volume_create_manager' (003b132b-c9c5-48f5-ad0e-5a5690533962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:35 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-e0586b0e-e402-424a-8c55-2e9dd5fb3181 tempest-VolumeDependencyTests-1261152157 None] Created volume successfully. Sep 07 14:03:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2b9f2c09-786f-415b-b4e3-f237b8dbf7cb tempest-VolumeDependencyTests-1261152157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2b9f2c09-786f-415b-b4e3-f237b8dbf7cb tempest-VolumeDependencyTests-1261152157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:35 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-2b9f2c09-786f-415b-b4e3-f237b8dbf7cb tempest-VolumeDependencyTests-1261152157 None] Creating offline snapshot b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd of volume 4fce6789-b9ef-48bd-abea-bf54d8044e9e {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:03:35 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d41816-0ee7-473b-9cf6-798014532e0d]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2b9f2c09-786f-415b-b4e3-f237b8dbf7cb tempest-VolumeDependencyTests-1261152157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:36 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e Sep 07 14:03:36 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:36 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2b9f2c09-786f-415b-b4e3-f237b8dbf7cb tempest-VolumeDependencyTests-1261152157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e" returned: 0 in 0.354s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2b9f2c09-786f-415b-b4e3-f237b8dbf7cb tempest-VolumeDependencyTests-1261152157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:36 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd 1G Sep 07 14:03:36 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:36 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2b9f2c09-786f-415b-b4e3-f237b8dbf7cb tempest-VolumeDependencyTests-1261152157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd 1G" returned: 0 in 0.363s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2b9f2c09-786f-415b-b4e3-f237b8dbf7cb tempest-VolumeDependencyTests-1261152157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:36 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd Sep 07 14:03:36 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:36 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2b9f2c09-786f-415b-b4e3-f237b8dbf7cb tempest-VolumeDependencyTests-1261152157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd" returned: 0 in 0.289s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:36 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-2b9f2c09-786f-415b-b4e3-f237b8dbf7cb tempest-VolumeDependencyTests-1261152157 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd is being set with open permissions: ugo+rw Sep 07 14:03:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2b9f2c09-786f-415b-b4e3-f237b8dbf7cb tempest-VolumeDependencyTests-1261152157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:36 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd Sep 07 14:03:36 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:37 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2b9f2c09-786f-415b-b4e3-f237b8dbf7cb tempest-VolumeDependencyTests-1261152157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd" returned: 0 in 0.234s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2b9f2c09-786f-415b-b4e3-f237b8dbf7cb tempest-VolumeDependencyTests-1261152157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:37 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.info Sep 07 14:03:37 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:37 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2b9f2c09-786f-415b-b4e3-f237b8dbf7cb tempest-VolumeDependencyTests-1261152157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.info" returned: 0 in 0.263s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:37 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-2b9f2c09-786f-415b-b4e3-f237b8dbf7cb tempest-VolumeDependencyTests-1261152157 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.info is being set with open permissions: ugo+rw Sep 07 14:03:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2b9f2c09-786f-415b-b4e3-f237b8dbf7cb tempest-VolumeDependencyTests-1261152157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:37 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.info Sep 07 14:03:37 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:37 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2b9f2c09-786f-415b-b4e3-f237b8dbf7cb tempest-VolumeDependencyTests-1261152157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.info" returned: 0 in 0.253s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2b9f2c09-786f-415b-b4e3-f237b8dbf7cb tempest-VolumeDependencyTests-1261152157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.844s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:37 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-2b9f2c09-786f-415b-b4e3-f237b8dbf7cb tempest-VolumeDependencyTests-1261152157 None] Create snapshot completed successfully Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Flow 'volume_create_manager' (d81a8965-c914-40e2-9e43-ddb5711c1511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50023c3c-293c-4fc8-b4b6-855014be65e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50023c3c-293c-4fc8-b4b6-855014be65e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1695903233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e2fb688-e453-4379-988c-a3ec1312fcba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f7da0bbe2a42c28a57aa46af48827b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:38Z,use_quota=True,user_id='b22019cf84304eb698ff05b8867fafd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70776731-d4f2-4ec3-b5fe-3f0811ec009a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70776731-d4f2-4ec3-b5fe-3f0811ec009a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a8d1af-09a2-4725-91eb-267def208bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a8d1af-09a2-4725-91eb-267def208bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1e2fb688-e453-4379-988c-a3ec1312fcba', 'volume_name': 'volume-1e2fb688-e453-4379-988c-a3ec1312fcba', 'volume_size': 1, 'snapshot_id': 'b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd'}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84403fe4-cc64-44ce-b706-f7946e20a200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84403fe4-cc64-44ce-b706-f7946e20a200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a79c2c-50e1-4b87-b762-9b1655d2fff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:38 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Volume 1e2fb688-e453-4379-988c-a3ec1312fcba: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1e2fb688-e453-4379-988c-a3ec1312fcba', 'volume_size': 1, 'snapshot_id': 'b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd'} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Acquiring lock "cinder-quobyte-b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd-1e2fb688-e453-4379-988c-a3ec1312fcba" by "_create_volume_from_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Lock "cinder-quobyte-b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd-1e2fb688-e453-4379-988c-a3ec1312fcba" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Creating volume 1e2fb688-e453-4379-988c-a3ec1312fcba from snapshot b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd {{(pid=87571) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Acquiring lock "cinder-quobyte-1e2fb688-e453-4379-988c-a3ec1312fcba" by "_copy_volume_from_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Lock "cinder-quobyte-1e2fb688-e453-4379-988c-a3ec1312fcba" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] snapshot: b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd, volume: 1e2fb688-e453-4379-988c-a3ec1312fcba, {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7d37ab-93bd-4801-9d54-2df0559d0d27]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:38 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd Sep 07 14:03:38 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:39 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd" returned: 0 in 0.350s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:03:39 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[deccaaee-f68f-47cc-bb10-d91a312ae41b]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:39 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e Sep 07 14:03:39 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:39 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e" returned: 0 in 0.349s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 14:03:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Creating direct copy from snapshot {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 14:03:39 devstack cinder-volume[87571]: DEBUG cinder.utils [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Path /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e2fb688-e453-4379-988c-a3ec1312fcba not found in is_blk_device check {{(pid=87571) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 14:03:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e2fb688-e453-4379-988c-a3ec1312fcba {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:39 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e2fb688-e453-4379-988c-a3ec1312fcba Sep 07 14:03:39 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:43 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e2fb688-e453-4379-988c-a3ec1312fcba" returned: 0 in 3.756s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:43 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e, size 1024.00 MB, duration 3.76 sec, destination /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e2fb688-e453-4379-988c-a3ec1312fcba {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 14:03:43 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Converted 1024.00 MB image at 272.46 MB/s Sep 07 14:03:43 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e2fb688-e453-4379-988c-a3ec1312fcba is being set with open permissions: ugo+rw Sep 07 14:03:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e2fb688-e453-4379-988c-a3ec1312fcba {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:43 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e2fb688-e453-4379-988c-a3ec1312fcba Sep 07 14:03:43 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:43 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e2fb688-e453-4379-988c-a3ec1312fcba" returned: 0 in 0.231s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Lock "cinder-quobyte-1e2fb688-e453-4379-988c-a3ec1312fcba" released by "_copy_volume_from_snapshot" :: held 4.764s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Lock "cinder-quobyte-b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd-1e2fb688-e453-4379-988c-a3ec1312fcba" released by "_create_volume_from_snapshot" :: held 4.820s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.834s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:43 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a79c2c-50e1-4b87-b762-9b1655d2fff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e2fb688-e453-4379-988c-a3ec1312fcba', 'volume_size': 1, 'snapshot_id': 'b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd'}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:43 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09100ac2-356d-43ec-b4e7-fd067b210ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:43 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Volume volume-1e2fb688-e453-4379-988c-a3ec1312fcba (1e2fb688-e453-4379-988c-a3ec1312fcba): created successfully Sep 07 14:03:43 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09100ac2-356d-43ec-b4e7-fd067b210ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:43 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Flow 'volume_create_manager' (d81a8965-c914-40e2-9e43-ddb5711c1511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:43 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-2a0e2acc-4ae2-49d4-ad5b-0bb7a889bfed tempest-VolumeDependencyTests-1261152157 None] Created volume successfully. Sep 07 14:03:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cd6817b5-6b47-4f80-b056-8f9d500f6d8c tempest-VolumeDependencyTests-1261152157 None] Acquiring lock "cinder-b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cd6817b5-6b47-4f80-b056-8f9d500f6d8c tempest-VolumeDependencyTests-1261152157 None] Lock "cinder-b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cd6817b5-6b47-4f80-b056-8f9d500f6d8c tempest-VolumeDependencyTests-1261152157 None] Acquiring lock "cinder-quobyte-4fce6789-b9ef-48bd-abea-bf54d8044e9e" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cd6817b5-6b47-4f80-b056-8f9d500f6d8c tempest-VolumeDependencyTests-1261152157 None] Lock "cinder-quobyte-4fce6789-b9ef-48bd-abea-bf54d8044e9e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cd6817b5-6b47-4f80-b056-8f9d500f6d8c tempest-VolumeDependencyTests-1261152157 None] Acquiring lock "cinder-quobyte-b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cd6817b5-6b47-4f80-b056-8f9d500f6d8c tempest-VolumeDependencyTests-1261152157 None] Lock "cinder-quobyte-b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-cd6817b5-6b47-4f80-b056-8f9d500f6d8c tempest-VolumeDependencyTests-1261152157 None] Deleting offline snapshot b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd of volume 4fce6789-b9ef-48bd-abea-bf54d8044e9e {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:03:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-cd6817b5-6b47-4f80-b056-8f9d500f6d8c tempest-VolumeDependencyTests-1261152157 None] snapshot_file for this snap is: volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:03:44 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c36efb-24af-4c22-8021-04af7b002544]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cd6817b5-6b47-4f80-b056-8f9d500f6d8c tempest-VolumeDependencyTests-1261152157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:44 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd Sep 07 14:03:44 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:44 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cd6817b5-6b47-4f80-b056-8f9d500f6d8c tempest-VolumeDependencyTests-1261152157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd" returned: 0 in 0.331s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-cd6817b5-6b47-4f80-b056-8f9d500f6d8c tempest-VolumeDependencyTests-1261152157 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:03:44 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[384c1afd-3a45-442a-a543-3b4da473fc1b]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cd6817b5-6b47-4f80-b056-8f9d500f6d8c tempest-VolumeDependencyTests-1261152157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:44 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e Sep 07 14:03:44 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:45 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cd6817b5-6b47-4f80-b056-8f9d500f6d8c tempest-VolumeDependencyTests-1261152157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e" returned: 0 in 0.498s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cd6817b5-6b47-4f80-b056-8f9d500f6d8c tempest-VolumeDependencyTests-1261152157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:45 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd Sep 07 14:03:45 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:45 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cd6817b5-6b47-4f80-b056-8f9d500f6d8c tempest-VolumeDependencyTests-1261152157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd" returned: 0 in 0.309s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cd6817b5-6b47-4f80-b056-8f9d500f6d8c tempest-VolumeDependencyTests-1261152157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:45 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd Sep 07 14:03:45 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:45 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-cd6817b5-6b47-4f80-b056-8f9d500f6d8c tempest-VolumeDependencyTests-1261152157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e.b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd" returned: 0 in 0.224s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:45 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cd6817b5-6b47-4f80-b056-8f9d500f6d8c tempest-VolumeDependencyTests-1261152157 None] Lock "cinder-quobyte-b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd" released by "_delete_snapshot" :: held 1.454s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:45 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cd6817b5-6b47-4f80-b056-8f9d500f6d8c tempest-VolumeDependencyTests-1261152157 None] Lock "cinder-quobyte-4fce6789-b9ef-48bd-abea-bf54d8044e9e" released by "delete_snapshot" :: held 1.475s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:45 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-cd6817b5-6b47-4f80-b056-8f9d500f6d8c tempest-VolumeDependencyTests-1261152157 None] Created reservations ['251369bd-03f0-49be-875a-064b1969af0c', '5ee99211-b645-4437-abf3-e544347b4a13', 'f3c3a520-dd37-43f3-9810-b8018eb63ba2', '37f1e22a-a6ab-42f0-94e4-77c0ec9c1056'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:03:45 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-cd6817b5-6b47-4f80-b056-8f9d500f6d8c tempest-VolumeDependencyTests-1261152157 None] Delete snapshot completed successfully. Sep 07 14:03:45 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-cd6817b5-6b47-4f80-b056-8f9d500f6d8c tempest-VolumeDependencyTests-1261152157 None] Lock "cinder-b2eee2a3-3db6-44b6-a9d1-3d7918eef5bd-delete_snapshot" released by "delete_snapshot" :: held 1.608s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:46 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1237872f-25a5-42a9-b27e-c2d89a2952d0 tempest-VolumeDependencyTests-1261152157 None] Acquiring lock "cinder-4fce6789-b9ef-48bd-abea-bf54d8044e9e-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:46 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1237872f-25a5-42a9-b27e-c2d89a2952d0 tempest-VolumeDependencyTests-1261152157 None] Lock "cinder-4fce6789-b9ef-48bd-abea-bf54d8044e9e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:46 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1237872f-25a5-42a9-b27e-c2d89a2952d0 tempest-VolumeDependencyTests-1261152157 None] Acquiring lock "cinder-quobyte-4fce6789-b9ef-48bd-abea-bf54d8044e9e" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:46 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1237872f-25a5-42a9-b27e-c2d89a2952d0 tempest-VolumeDependencyTests-1261152157 None] Lock "cinder-quobyte-4fce6789-b9ef-48bd-abea-bf54d8044e9e" acquired by "delete_volume" :: waited 0.012s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:46 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c663e0-0f72-4802-bcd2-06bd8cad1c5b]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1237872f-25a5-42a9-b27e-c2d89a2952d0 tempest-VolumeDependencyTests-1261152157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:46 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e Sep 07 14:03:46 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:46 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1237872f-25a5-42a9-b27e-c2d89a2952d0 tempest-VolumeDependencyTests-1261152157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e" returned: 0 in 0.346s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1237872f-25a5-42a9-b27e-c2d89a2952d0 tempest-VolumeDependencyTests-1261152157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:46 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e Sep 07 14:03:46 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:47 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1237872f-25a5-42a9-b27e-c2d89a2952d0 tempest-VolumeDependencyTests-1261152157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-4fce6789-b9ef-48bd-abea-bf54d8044e9e" returned: 0 in 0.250s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1237872f-25a5-42a9-b27e-c2d89a2952d0 tempest-VolumeDependencyTests-1261152157 None] Lock "cinder-quobyte-4fce6789-b9ef-48bd-abea-bf54d8044e9e" released by "delete_volume" :: held 0.646s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:47 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-1237872f-25a5-42a9-b27e-c2d89a2952d0 tempest-VolumeDependencyTests-1261152157 None] Created reservations ['bbb2e208-9479-407c-885c-b84051e13f92', '285988db-254c-4778-ad6b-f8f3c17c99e9', 'b217f103-dba7-4e88-bda8-b356c3148746', '896f3a73-e533-4c91-ad65-935e9176b8a6'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:03:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1237872f-25a5-42a9-b27e-c2d89a2952d0 tempest-VolumeDependencyTests-1261152157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1237872f-25a5-42a9-b27e-c2d89a2952d0 tempest-VolumeDependencyTests-1261152157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1237872f-25a5-42a9-b27e-c2d89a2952d0 tempest-VolumeDependencyTests-1261152157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1237872f-25a5-42a9-b27e-c2d89a2952d0 tempest-VolumeDependencyTests-1261152157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1237872f-25a5-42a9-b27e-c2d89a2952d0 tempest-VolumeDependencyTests-1261152157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1237872f-25a5-42a9-b27e-c2d89a2952d0 tempest-VolumeDependencyTests-1261152157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:47 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:03:47 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:47 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1237872f-25a5-42a9-b27e-c2d89a2952d0 tempest-VolumeDependencyTests-1261152157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.236s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:47 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-1237872f-25a5-42a9-b27e-c2d89a2952d0 tempest-VolumeDependencyTests-1261152157 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:03:47 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-1237872f-25a5-42a9-b27e-c2d89a2952d0 tempest-VolumeDependencyTests-1261152157 None] Deleted volume successfully. Sep 07 14:03:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-1237872f-25a5-42a9-b27e-c2d89a2952d0 tempest-VolumeDependencyTests-1261152157 None] Lock "cinder-4fce6789-b9ef-48bd-abea-bf54d8044e9e-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a3cd65ff-a9e3-49f4-a24a-562500f71693 tempest-VolumeDependencyTests-1261152157 None] Acquiring lock "cinder-1e2fb688-e453-4379-988c-a3ec1312fcba-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a3cd65ff-a9e3-49f4-a24a-562500f71693 tempest-VolumeDependencyTests-1261152157 None] Lock "cinder-1e2fb688-e453-4379-988c-a3ec1312fcba-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a3cd65ff-a9e3-49f4-a24a-562500f71693 tempest-VolumeDependencyTests-1261152157 None] Acquiring lock "cinder-quobyte-1e2fb688-e453-4379-988c-a3ec1312fcba" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a3cd65ff-a9e3-49f4-a24a-562500f71693 tempest-VolumeDependencyTests-1261152157 None] Lock "cinder-quobyte-1e2fb688-e453-4379-988c-a3ec1312fcba" acquired by "delete_volume" :: waited 0.015s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:47 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[74176e5e-9eab-4e87-8999-f110d80cf7b6]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a3cd65ff-a9e3-49f4-a24a-562500f71693 tempest-VolumeDependencyTests-1261152157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e2fb688-e453-4379-988c-a3ec1312fcba {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:47 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e2fb688-e453-4379-988c-a3ec1312fcba Sep 07 14:03:47 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:47 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a3cd65ff-a9e3-49f4-a24a-562500f71693 tempest-VolumeDependencyTests-1261152157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e2fb688-e453-4379-988c-a3ec1312fcba" returned: 0 in 0.363s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a3cd65ff-a9e3-49f4-a24a-562500f71693 tempest-VolumeDependencyTests-1261152157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e2fb688-e453-4379-988c-a3ec1312fcba {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:47 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e2fb688-e453-4379-988c-a3ec1312fcba Sep 07 14:03:47 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:48 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a3cd65ff-a9e3-49f4-a24a-562500f71693 tempest-VolumeDependencyTests-1261152157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e2fb688-e453-4379-988c-a3ec1312fcba" returned: 0 in 0.248s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a3cd65ff-a9e3-49f4-a24a-562500f71693 tempest-VolumeDependencyTests-1261152157 None] Lock "cinder-quobyte-1e2fb688-e453-4379-988c-a3ec1312fcba" released by "delete_volume" :: held 0.653s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:48 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-a3cd65ff-a9e3-49f4-a24a-562500f71693 tempest-VolumeDependencyTests-1261152157 None] Created reservations ['219261f4-9d9c-41d7-b414-8be29c882fd7', 'f0bcd05f-3597-426a-92d8-d1102af91e50', 'd0b35735-d59a-4cbe-954f-6cec2af3c959', 'db501fa4-e8fe-480a-a412-9214c173111d'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:03:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a3cd65ff-a9e3-49f4-a24a-562500f71693 tempest-VolumeDependencyTests-1261152157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a3cd65ff-a9e3-49f4-a24a-562500f71693 tempest-VolumeDependencyTests-1261152157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd65ff-a9e3-49f4-a24a-562500f71693 tempest-VolumeDependencyTests-1261152157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd65ff-a9e3-49f4-a24a-562500f71693 tempest-VolumeDependencyTests-1261152157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a3cd65ff-a9e3-49f4-a24a-562500f71693 tempest-VolumeDependencyTests-1261152157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a3cd65ff-a9e3-49f4-a24a-562500f71693 tempest-VolumeDependencyTests-1261152157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:48 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:03:48 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:48 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a3cd65ff-a9e3-49f4-a24a-562500f71693 tempest-VolumeDependencyTests-1261152157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.242s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:48 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-a3cd65ff-a9e3-49f4-a24a-562500f71693 tempest-VolumeDependencyTests-1261152157 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:03:48 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-a3cd65ff-a9e3-49f4-a24a-562500f71693 tempest-VolumeDependencyTests-1261152157 None] Deleted volume successfully. Sep 07 14:03:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a3cd65ff-a9e3-49f4-a24a-562500f71693 tempest-VolumeDependencyTests-1261152157 None] Lock "cinder-1e2fb688-e453-4379-988c-a3ec1312fcba-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:58 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=80,cinder:INSERT=26,cinder:UPDATE=93,cinder:DELETE=5 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:03:58 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=65,cinder:UPDATE=100,cinder:INSERT=29,cinder:DELETE=12 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Flow 'volume_create_manager' (56675dd3-a843-4472-98f3-3025a51d425b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8e4957-77dc-487d-8c14-ced4e7c3585d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8e4957-77dc-487d-8c14-ced4e7c3585d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-761905167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c51cbb5-01da-45ca-a426-4c5e2ff0b436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf1fb10018a46279bd9f9428e17d7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:00Z,use_quota=True,user_id='3761186c2404475ab8b191d5226a0719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60131132-b435-4166-877d-649f1b0f2853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60131132-b435-4166-877d-649f1b0f2853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81891eff-045a-4775-9482-8b2c615ba80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81891eff-045a-4775-9482-8b2c615ba80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c51cbb5-01da-45ca-a426-4c5e2ff0b436', 'volume_name': 'volume-9c51cbb5-01da-45ca-a426-4c5e2ff0b436', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e33d2f-a6d9-4287-a119-e9486ab02f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e33d2f-a6d9-4287-a119-e9486ab02f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae247c1-a6b9-4d68-bfa4-fdd78597b05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:00 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Volume 9c51cbb5-01da-45ca-a426-4c5e2ff0b436: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c51cbb5-01da-45ca-a426-4c5e2ff0b436', 'volume_size': 1} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-761905167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c51cbb5-01da-45ca-a426-4c5e2ff0b436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf1fb10018a46279bd9f9428e17d7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:00Z,use_quota=True,user_id='3761186c2404475ab8b191d5226a0719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Creating volume 9c51cbb5-01da-45ca-a426-4c5e2ff0b436 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:00 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c51cbb5-01da-45ca-a426-4c5e2ff0b436 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:00 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c51cbb5-01da-45ca-a426-4c5e2ff0b436 1073741824 Sep 07 14:04:00 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Flow 'volume_create_manager' (dd240bb4-475b-460f-97a3-840bad0ff308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb73de4a-ccad-4127-80ab-3845b60a1f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb73de4a-ccad-4127-80ab-3845b60a1f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-740403136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49495391-0397-4f7b-9926-b028e088f9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc400a4212e545b4acffe914ceec553a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:01Z,use_quota=True,user_id='cab0a25a6c7449478a82a593c33f1ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f62a6ac0-c91d-4366-af59-49c96c9434d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f62a6ac0-c91d-4366-af59-49c96c9434d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (615c137d-df8a-4e27-8e18-65ca430cf29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (615c137d-df8a-4e27-8e18-65ca430cf29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49495391-0397-4f7b-9926-b028e088f9a9', 'volume_name': 'volume-49495391-0397-4f7b-9926-b028e088f9a9', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d2ea26-0e78-4041-9f45-bd77c27d895b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d2ea26-0e78-4041-9f45-bd77c27d895b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (742c185f-1db7-4a89-b219-591557ec9a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:00 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Volume 49495391-0397-4f7b-9926-b028e088f9a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49495391-0397-4f7b-9926-b028e088f9a9', 'volume_size': 1} Sep 07 14:04:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Flow 'volume_create_manager' (30fe488c-f1e9-4376-be1d-4b75e0c62fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58a37b8-1639-4e12-bcad-19534eb7cd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58a37b8-1639-4e12-bcad-19534eb7cd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-721990407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf47a55-28f0-4438-a6ac-a2380d803b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf1fb10018a46279bd9f9428e17d7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:01Z,use_quota=True,user_id='3761186c2404475ab8b191d5226a0719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e90a020-888f-4a19-97a8-4fe6aa3ea546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e90a020-888f-4a19-97a8-4fe6aa3ea546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e54c17fc-bce6-4d8a-b75d-c903f8d5b9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e54c17fc-bce6-4d8a-b75d-c903f8d5b9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abf47a55-28f0-4438-a6ac-a2380d803b57', 'volume_name': 'volume-abf47a55-28f0-4438-a6ac-a2380d803b57', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b64117c-a743-4302-822b-25cab1912d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b64117c-a743-4302-822b-25cab1912d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16569f09-874f-4f33-801f-e57277c3659c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:01 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Volume abf47a55-28f0-4438-a6ac-a2380d803b57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abf47a55-28f0-4438-a6ac-a2380d803b57', 'volume_size': 1} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:01 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Flow 'volume_create_manager' (f6f85213-ae6c-416c-ae71-848f10e09bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f698a8e-2520-4e55-8498-50433f8b0fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c51cbb5-01da-45ca-a426-4c5e2ff0b436 1073741824" returned: 0 in 0.612s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f698a8e-2520-4e55-8498-50433f8b0fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-52906489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c2cd4b-50d3-47d4-8833-9df3e829bd35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc7e7396b4246aaa1eec58aac5ab826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:01Z,use_quota=True,user_id='240bb4ad61de46bb8b30de1ca47885e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd9fc614-0c50-44e2-9b93-2adee7fbf2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd9fc614-0c50-44e2-9b93-2adee7fbf2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627d3b21-bddc-4f37-856c-17dd60821966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627d3b21-bddc-4f37-856c-17dd60821966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50c2cd4b-50d3-47d4-8833-9df3e829bd35', 'volume_name': 'volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9648a39-befa-46e9-857d-f1413fcf1efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9648a39-befa-46e9-857d-f1413fcf1efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa7e10e-990b-427c-99a6-009356518244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:01 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Volume 50c2cd4b-50d3-47d4-8833-9df3e829bd35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35', 'volume_size': 1} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c51cbb5-01da-45ca-a426-4c5e2ff0b436 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:01 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c51cbb5-01da-45ca-a426-4c5e2ff0b436 Sep 07 14:04:01 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Flow 'volume_create_manager' (82030d84-798a-4e99-8ae6-918bcf0348eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f3d35d-21ae-450e-9299-173f09ac76ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f3d35d-21ae-450e-9299-173f09ac76ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1201532280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3928e805-3f06-402b-aade-a894057f726e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf1fb10018a46279bd9f9428e17d7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:02Z,use_quota=True,user_id='3761186c2404475ab8b191d5226a0719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e08c5b3-376b-4bd0-83d3-e19fc016377a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e08c5b3-376b-4bd0-83d3-e19fc016377a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2bc9b4-6d7a-4ee2-b647-038434043db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:01 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2bc9b4-6d7a-4ee2-b647-038434043db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3928e805-3f06-402b-aade-a894057f726e', 'volume_name': 'volume-3928e805-3f06-402b-aade-a894057f726e', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d11314f3-352c-45ca-864a-8eeedfdf6ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d11314f3-352c-45ca-864a-8eeedfdf6ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2664b821-c5f7-4dba-b568-becbc575b640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:01 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Volume 3928e805-3f06-402b-aade-a894057f726e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3928e805-3f06-402b-aade-a894057f726e', 'volume_size': 1} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c51cbb5-01da-45ca-a426-4c5e2ff0b436" returned: 0 in 0.322s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.900s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-740403136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49495391-0397-4f7b-9926-b028e088f9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc400a4212e545b4acffe914ceec553a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:01Z,use_quota=True,user_id='cab0a25a6c7449478a82a593c33f1ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Creating volume 49495391-0397-4f7b-9926-b028e088f9a9 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:01 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49495391-0397-4f7b-9926-b028e088f9a9 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae247c1-a6b9-4d68-bfa4-fdd78597b05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c51cbb5-01da-45ca-a426-4c5e2ff0b436', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:01 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49495391-0397-4f7b-9926-b028e088f9a9 1073741824 Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8da3f2-2a7d-4935-89c4-ee5f132644db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:01 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:01 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Volume volume-9c51cbb5-01da-45ca-a426-4c5e2ff0b436 (9c51cbb5-01da-45ca-a426-4c5e2ff0b436): created successfully Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8da3f2-2a7d-4935-89c4-ee5f132644db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:01 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Flow 'volume_create_manager' (56675dd3-a843-4472-98f3-3025a51d425b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:01 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-d74583fe-66fe-450d-b7eb-f67ce6bdb7c9 tempest-CreateVolumesFromImageTest-158775323 None] Created volume successfully. Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Flow 'volume_create_manager' (4f2ef258-66f1-473f-9544-858f61cc024b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8888e68f-51a7-4c18-a55c-508bd1f268ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8888e68f-51a7-4c18-a55c-508bd1f268ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-328372237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=145e5f72-6b67-4d32-bbe7-181146277b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf1fb10018a46279bd9f9428e17d7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:02Z,use_quota=True,user_id='3761186c2404475ab8b191d5226a0719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc9791b-1a63-4e4a-b7ee-8fe215a4354d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc9791b-1a63-4e4a-b7ee-8fe215a4354d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515d4641-f115-4f2c-ba6b-ac86a6d48af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515d4641-f115-4f2c-ba6b-ac86a6d48af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '145e5f72-6b67-4d32-bbe7-181146277b98', 'volume_name': 'volume-145e5f72-6b67-4d32-bbe7-181146277b98', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fb4f09-9e90-414a-ab0d-c251206b9063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fb4f09-9e90-414a-ab0d-c251206b9063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e7b480-4010-4c36-9206-cdb22e4bb785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:02 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Volume 145e5f72-6b67-4d32-bbe7-181146277b98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-145e5f72-6b67-4d32-bbe7-181146277b98', 'volume_size': 1} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:02 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49495391-0397-4f7b-9926-b028e088f9a9 1073741824" returned: 0 in 0.565s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49495391-0397-4f7b-9926-b028e088f9a9 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:02 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49495391-0397-4f7b-9926-b028e088f9a9 Sep 07 14:04:02 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Flow 'volume_create_manager' (3f3395c8-212b-4dd5-b3f5-01fccbb9414a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb53ddf5-13b9-4b19-a82a-e550680a2f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb53ddf5-13b9-4b19-a82a-e550680a2f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-583234280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=091b016d-b79e-4fae-bc46-4af275678f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf1fb10018a46279bd9f9428e17d7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:02Z,use_quota=True,user_id='3761186c2404475ab8b191d5226a0719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02257b6-88e2-4405-907c-55e9449645c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02257b6-88e2-4405-907c-55e9449645c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd8bb9b-f010-4f41-85ce-ca016399ec8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd8bb9b-f010-4f41-85ce-ca016399ec8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '091b016d-b79e-4fae-bc46-4af275678f2f', 'volume_name': 'volume-091b016d-b79e-4fae-bc46-4af275678f2f', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987fd2cf-af91-4c98-94f3-2a8182d7d1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987fd2cf-af91-4c98-94f3-2a8182d7d1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22cd608f-20c4-487a-b21b-b7384eef53f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:02 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Volume 091b016d-b79e-4fae-bc46-4af275678f2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-091b016d-b79e-4fae-bc46-4af275678f2f', 'volume_size': 1} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:02 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49495391-0397-4f7b-9926-b028e088f9a9" returned: 0 in 0.284s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.521s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-721990407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf47a55-28f0-4438-a6ac-a2380d803b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf1fb10018a46279bd9f9428e17d7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:01Z,use_quota=True,user_id='3761186c2404475ab8b191d5226a0719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Creating volume abf47a55-28f0-4438-a6ac-a2380d803b57 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:02 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abf47a55-28f0-4438-a6ac-a2380d803b57 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:02 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abf47a55-28f0-4438-a6ac-a2380d803b57 1073741824 Sep 07 14:04:02 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (742c185f-1db7-4a89-b219-591557ec9a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49495391-0397-4f7b-9926-b028e088f9a9', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de516aaa-ec6e-4247-9a30-5c24a11adc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:02 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Volume volume-49495391-0397-4f7b-9926-b028e088f9a9 (49495391-0397-4f7b-9926-b028e088f9a9): created successfully Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de516aaa-ec6e-4247-9a30-5c24a11adc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Flow 'volume_create_manager' (dd240bb4-475b-460f-97a3-840bad0ff308) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:02 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-993d348c-316b-413d-a83a-758353e9d0ce tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Created volume successfully. Sep 07 14:04:03 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abf47a55-28f0-4438-a6ac-a2380d803b57 1073741824" returned: 0 in 0.504s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abf47a55-28f0-4438-a6ac-a2380d803b57 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:03 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abf47a55-28f0-4438-a6ac-a2380d803b57 Sep 07 14:04:03 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Flow 'volume_create_manager' (05434f53-4237-4149-a455-caac81028742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36819ed3-4917-4b93-955f-aead4ce33dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36819ed3-4917-4b93-955f-aead4ce33dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-100758262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a55f1d-23b9-4174-ba36-8bacda32daf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc400a4212e545b4acffe914ceec553a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:04Z,use_quota=True,user_id='cab0a25a6c7449478a82a593c33f1ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:03 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d27326-2e3a-4d41-b9d5-42dbffdd4ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d27326-2e3a-4d41-b9d5-42dbffdd4ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae450b7-2ea6-4e6e-b1e3-1e4ec6731313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae450b7-2ea6-4e6e-b1e3-1e4ec6731313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4a55f1d-23b9-4174-ba36-8bacda32daf7', 'volume_name': 'volume-e4a55f1d-23b9-4174-ba36-8bacda32daf7', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c0e6bd-440c-481a-8436-7e837a437f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c0e6bd-440c-481a-8436-7e837a437f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc847f5-bd45-4777-bde5-c2e55bd18ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:03 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Volume e4a55f1d-23b9-4174-ba36-8bacda32daf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4a55f1d-23b9-4174-ba36-8bacda32daf7', 'volume_size': 1} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abf47a55-28f0-4438-a6ac-a2380d803b57" returned: 0 in 0.390s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.208s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-52906489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c2cd4b-50d3-47d4-8833-9df3e829bd35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc7e7396b4246aaa1eec58aac5ab826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:01Z,use_quota=True,user_id='240bb4ad61de46bb8b30de1ca47885e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Creating volume 50c2cd4b-50d3-47d4-8833-9df3e829bd35 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:03 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:03 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35 1073741824 Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16569f09-874f-4f33-801f-e57277c3659c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf47a55-28f0-4438-a6ac-a2380d803b57', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:03 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c8b24bb-e291-4591-aaff-b38c6cf0c1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:03 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Volume volume-abf47a55-28f0-4438-a6ac-a2380d803b57 (abf47a55-28f0-4438-a6ac-a2380d803b57): created successfully Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c8b24bb-e291-4591-aaff-b38c6cf0c1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Flow 'volume_create_manager' (30fe488c-f1e9-4376-be1d-4b75e0c62fef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:03 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-835903fa-2e3b-42b5-8ed7-a224b662268c tempest-CreateVolumesFromImageTest-158775323 None] Created volume successfully. Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Flow 'volume_create_manager' (233e786b-781d-4a90-abc7-5224ada36fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69601c01-2feb-4dca-820c-fbc38ed58335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69601c01-2feb-4dca-820c-fbc38ed58335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1550136720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d49d48-3186-447b-b0f8-3e1010733a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc400a4212e545b4acffe914ceec553a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:04Z,use_quota=True,user_id='cab0a25a6c7449478a82a593c33f1ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e368ca-4a6d-47f2-9340-f0cd56e40cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e368ca-4a6d-47f2-9340-f0cd56e40cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa4daee4-84f3-45ae-9170-10184ccd18d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa4daee4-84f3-45ae-9170-10184ccd18d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8d49d48-3186-447b-b0f8-3e1010733a0b', 'volume_name': 'volume-b8d49d48-3186-447b-b0f8-3e1010733a0b', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b39e8e8b-b99f-4ac5-bda3-f74d36128ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b39e8e8b-b99f-4ac5-bda3-f74d36128ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79bf27ab-0554-4638-b023-a51f70e447f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:04 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Volume b8d49d48-3186-447b-b0f8-3e1010733a0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8d49d48-3186-447b-b0f8-3e1010733a0b', 'volume_size': 1} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:04 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35 1073741824" returned: 0 in 0.559s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:04 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35 Sep 07 14:04:04 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Flow 'volume_create_manager' (d1880056-45a3-4528-a4b9-5133673d016a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faabb424-30f1-4540-b2d9-b6831e0b0654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faabb424-30f1-4540-b2d9-b6831e0b0654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1178959018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cece5f8-f2d9-4f85-ae3f-3629af635e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc400a4212e545b4acffe914ceec553a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:04Z,use_quota=True,user_id='cab0a25a6c7449478a82a593c33f1ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89fb9fb-bcdf-489f-9614-4f48b59cd773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89fb9fb-bcdf-489f-9614-4f48b59cd773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc6c502-daa9-46c0-b47f-52880f918bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc6c502-daa9-46c0-b47f-52880f918bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cece5f8-f2d9-4f85-ae3f-3629af635e64', 'volume_name': 'volume-9cece5f8-f2d9-4f85-ae3f-3629af635e64', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e52a930-f6ac-479e-82b4-be4a30f0df0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e52a930-f6ac-479e-82b4-be4a30f0df0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75373ade-a901-40a2-9fff-480344b62164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:04 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Volume 9cece5f8-f2d9-4f85-ae3f-3629af635e64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cece5f8-f2d9-4f85-ae3f-3629af635e64', 'volume_size': 1} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:04 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35" returned: 0 in 0.300s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.768s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1201532280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3928e805-3f06-402b-aade-a894057f726e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf1fb10018a46279bd9f9428e17d7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:02Z,use_quota=True,user_id='3761186c2404475ab8b191d5226a0719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Creating volume 3928e805-3f06-402b-aade-a894057f726e {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:04 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3928e805-3f06-402b-aade-a894057f726e 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:04 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3928e805-3f06-402b-aade-a894057f726e 1073741824 Sep 07 14:04:04 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa7e10e-990b-427c-99a6-009356518244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66976227-6766-4654-ba09-8e17fae4f4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:04 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Volume volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35 (50c2cd4b-50d3-47d4-8833-9df3e829bd35): created successfully Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66976227-6766-4654-ba09-8e17fae4f4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:04 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Flow 'volume_create_manager' (f6f85213-ae6c-416c-ae71-848f10e09bc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:04 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-07c68881-663d-40ab-b761-45c8723fbc67 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Created volume successfully. Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Flow 'volume_create_manager' (d1b7f9ad-d3fe-4016-9ab3-0de92d832d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99070cea-e4c9-476f-b57e-6a8d1c60fdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99070cea-e4c9-476f-b57e-6a8d1c60fdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-771125886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeffd24c-d478-4b5e-80e0-7599eaec6909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc400a4212e545b4acffe914ceec553a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:05Z,use_quota=True,user_id='cab0a25a6c7449478a82a593c33f1ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f0d9cd-d543-434b-917a-4dad434ec91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f0d9cd-d543-434b-917a-4dad434ec91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea95cf2-ca63-43b7-ab43-01d7bd591c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea95cf2-ca63-43b7-ab43-01d7bd591c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeffd24c-d478-4b5e-80e0-7599eaec6909', 'volume_name': 'volume-eeffd24c-d478-4b5e-80e0-7599eaec6909', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3bbdeb-5876-4c95-8dd6-9c493f2c4354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3bbdeb-5876-4c95-8dd6-9c493f2c4354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c38deba-0d0b-4dee-b576-c331efa6a9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:05 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Volume eeffd24c-d478-4b5e-80e0-7599eaec6909: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeffd24c-d478-4b5e-80e0-7599eaec6909', 'volume_size': 1} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:05 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3928e805-3f06-402b-aade-a894057f726e 1073741824" returned: 0 in 0.598s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3928e805-3f06-402b-aade-a894057f726e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:05 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3928e805-3f06-402b-aade-a894057f726e Sep 07 14:04:05 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:05 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3928e805-3f06-402b-aade-a894057f726e" returned: 0 in 0.405s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.453s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-328372237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=145e5f72-6b67-4d32-bbe7-181146277b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf1fb10018a46279bd9f9428e17d7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:02Z,use_quota=True,user_id='3761186c2404475ab8b191d5226a0719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Creating volume 145e5f72-6b67-4d32-bbe7-181146277b98 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:05 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-145e5f72-6b67-4d32-bbe7-181146277b98 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2664b821-c5f7-4dba-b568-becbc575b640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3928e805-3f06-402b-aade-a894057f726e', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:05 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-145e5f72-6b67-4d32-bbe7-181146277b98 1073741824 Sep 07 14:04:05 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ac2f01-4e2c-462c-931a-dc0d942c974b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:05 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Volume volume-3928e805-3f06-402b-aade-a894057f726e (3928e805-3f06-402b-aade-a894057f726e): created successfully Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ac2f01-4e2c-462c-931a-dc0d942c974b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Flow 'volume_create_manager' (82030d84-798a-4e99-8ae6-918bcf0348eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:05 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-86be37c7-14a9-4736-9561-0fd02c5a2319 tempest-CreateVolumesFromImageTest-158775323 None] Created volume successfully. Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6c6f8b0c-fc68-4d8d-a8ed-c19c74c70262 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Flow 'volume_create_manager' (1f5887f2-5b15-4012-a803-a4f24075f379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c7936d-0270-4631-aaee-8e530db429e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c7936d-0270-4631-aaee-8e530db429e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1358284278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f9fc81-d86f-4469-9c85-b5da0eec3f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc400a4212e545b4acffe914ceec553a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:06Z,use_quota=True,user_id='cab0a25a6c7449478a82a593c33f1ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a50d40-c085-4ce1-bdab-d55210d9cbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a50d40-c085-4ce1-bdab-d55210d9cbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08fbf54a-3c4d-4c09-a2e7-ae50db546d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08fbf54a-3c4d-4c09-a2e7-ae50db546d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11f9fc81-d86f-4469-9c85-b5da0eec3f9b', 'volume_name': 'volume-11f9fc81-d86f-4469-9c85-b5da0eec3f9b', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d7e1be-33b7-46d7-878a-26d142019a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d7e1be-33b7-46d7-878a-26d142019a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54715f96-6683-4947-9f2f-64c8d7001db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:06 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Volume 11f9fc81-d86f-4469-9c85-b5da0eec3f9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11f9fc81-d86f-4469-9c85-b5da0eec3f9b', 'volume_size': 1} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Flow 'volume_create_manager' (7a37651e-f4de-4cfb-8ac4-d2c5a9e117ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60364352-710d-4ea1-ae30-f95da7864ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60364352-710d-4ea1-ae30-f95da7864ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f049aa09-3a03-47f2-96de-5fa13883c2f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8266ee66f264f08b441f6bb98794656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:06Z,use_quota=True,user_id='cbf0dad39a594a14b1cbffc7a79490eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06759d27-31f3-4b55-8c4a-bb244af8c610),volume_type_id=06759d27-31f3-4b55-8c4a-bb244af8c610)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527d8664-b4a1-4eac-8865-fa230cb073c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527d8664-b4a1-4eac-8865-fa230cb073c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c604d22b-0068-43a6-9ca9-b6a3b7f976a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:06 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.image.glance [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Creating Keystone auth plugin from conf {{(pid=87571) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-145e5f72-6b67-4d32-bbe7-181146277b98 1073741824" returned: 0 in 0.415s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-145e5f72-6b67-4d32-bbe7-181146277b98 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:06 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-145e5f72-6b67-4d32-bbe7-181146277b98 Sep 07 14:04:06 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c604d22b-0068-43a6-9ca9-b6a3b7f976a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f049aa09-3a03-47f2-96de-5fa13883c2f8', 'volume_name': 'volume-f049aa09-3a03-47f2-96de-5fa13883c2f8', 'volume_size': 1, 'image_id': '3f50be0f-8804-476a-943f-d1a695f930e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f50be0f-8804-476a-943f-d1a695f930e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '02370c5e4626c11a4a0200f1abcea491', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e8266ee66f264f08b441f6bb98794656', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04e485fc87641a1183b1396f2ea97c3a5c6ab2960608145b9fdbbef0b96707429e169e1942a20f613919417f83201e8d5f6c8525b0b9870b205091a782c900b9', 'id': '3f50be0f-8804-476a-943f-d1a695f930e0', 'created_at': datetime.datetime(2026, 9, 7, 12, 4, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 12, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f50be0f-8804-476a-943f-d1a695f930e0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c91076a-598d-4653-b5f6-138225985452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c91076a-598d-4653-b5f6-138225985452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7319d9-1ed4-4abf-ba32-5b38f130785b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:06 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Volume f049aa09-3a03-47f2-96de-5fa13883c2f8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f049aa09-3a03-47f2-96de-5fa13883c2f8', 'volume_size': 1, 'image_id': '3f50be0f-8804-476a-943f-d1a695f930e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f50be0f-8804-476a-943f-d1a695f930e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '02370c5e4626c11a4a0200f1abcea491', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e8266ee66f264f08b441f6bb98794656', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04e485fc87641a1183b1396f2ea97c3a5c6ab2960608145b9fdbbef0b96707429e169e1942a20f613919417f83201e8d5f6c8525b0b9870b205091a782c900b9', 'id': '3f50be0f-8804-476a-943f-d1a695f930e0', 'created_at': datetime.datetime(2026, 9, 7, 12, 4, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 12, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f50be0f-8804-476a-943f-d1a695f930e0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Trying to clone f049aa09-3a03-47f2-96de-5fa13883c2f8 from image 3f50be0f-8804-476a-943f-d1a695f930e0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3f50be0f-8804-476a-943f-d1a695f930e0', 'metadata': {}}]). {{(pid=87571) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1099}} Sep 07 14:04:06 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-145e5f72-6b67-4d32-bbe7-181146277b98" returned: 0 in 0.242s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.801s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-583234280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=091b016d-b79e-4fae-bc46-4af275678f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf1fb10018a46279bd9f9428e17d7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:02Z,use_quota=True,user_id='3761186c2404475ab8b191d5226a0719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Creating volume 091b016d-b79e-4fae-bc46-4af275678f2f {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:06 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-091b016d-b79e-4fae-bc46-4af275678f2f 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 14:04:06 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Image download 0.00 MB at 0.00 MB/s Sep 07 14:04:06 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-091b016d-b79e-4fae-bc46-4af275678f2f 1073741824 Sep 07 14:04:06 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e7b480-4010-4c36-9206-cdb22e4bb785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-145e5f72-6b67-4d32-bbe7-181146277b98', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c8330d-54d9-453a-a9a6-b42e430493bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:06 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Volume volume-145e5f72-6b67-4d32-bbe7-181146277b98 (145e5f72-6b67-4d32-bbe7-181146277b98): created successfully Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c8330d-54d9-453a-a9a6-b42e430493bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Flow 'volume_create_manager' (4f2ef258-66f1-473f-9544-858f61cc024b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:06 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c34d3b3e-1a42-47f8-a8a8-d4405f250516 tempest-CreateVolumesFromImageTest-158775323 None] Created volume successfully. Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2e90a6-3646-4939-a114-217fe185e1c4]: (4, 'raw') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:06 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD Sep 07 14:04:06 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:06 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-091b016d-b79e-4fae-bc46-4af275678f2f 1073741824" returned: 0 in 0.390s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-091b016d-b79e-4fae-bc46-4af275678f2f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:06 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:06 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-091b016d-b79e-4fae-bc46-4af275678f2f Sep 07 14:04:06 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:06 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD Sep 07 14:04:06 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:07 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-091b016d-b79e-4fae-bc46-4af275678f2f" returned: 0 in 0.244s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.390s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-100758262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a55f1d-23b9-4174-ba36-8bacda32daf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc400a4212e545b4acffe914ceec553a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:04Z,use_quota=True,user_id='cab0a25a6c7449478a82a593c33f1ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Creating volume e4a55f1d-23b9-4174-ba36-8bacda32daf7 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:07 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e4a55f1d-23b9-4174-ba36-8bacda32daf7 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22cd608f-20c4-487a-b21b-b7384eef53f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-091b016d-b79e-4fae-bc46-4af275678f2f', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:07 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e4a55f1d-23b9-4174-ba36-8bacda32daf7 1073741824 Sep 07 14:04:07 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aeffbf5-201f-4879-9579-188af2b7d2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:07 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Volume volume-091b016d-b79e-4fae-bc46-4af275678f2f (091b016d-b79e-4fae-bc46-4af275678f2f): created successfully Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aeffbf5-201f-4879-9579-188af2b7d2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Flow 'volume_create_manager' (3f3395c8-212b-4dd5-b3f5-01fccbb9414a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:07 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-128aac51-663a-483e-b757-9ca9edfabb20 tempest-CreateVolumesFromImageTest-158775323 None] Created volume successfully. Sep 07 14:04:07 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD" returned: 1 in 0.341s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Temporary image 3f50be0f-8804-476a-943f-d1a695f930e0 is fetched for user cbf0dad39a594a14b1cbffc7a79490eb. {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[04296f98-4af7-48f2-98c3-9033b03c9b5a]: (4, 'raw') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:07 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD Sep 07 14:04:07 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:07 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e4a55f1d-23b9-4174-ba36-8bacda32daf7 1073741824" returned: 0 in 0.397s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e4a55f1d-23b9-4174-ba36-8bacda32daf7 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:07 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e4a55f1d-23b9-4174-ba36-8bacda32daf7 Sep 07 14:04:07 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:07 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:07 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD Sep 07 14:04:07 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:07 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e4a55f1d-23b9-4174-ba36-8bacda32daf7" returned: 0 in 0.260s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.620s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1550136720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d49d48-3186-447b-b0f8-3e1010733a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc400a4212e545b4acffe914ceec553a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:04Z,use_quota=True,user_id='cab0a25a6c7449478a82a593c33f1ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Creating volume b8d49d48-3186-447b-b0f8-3e1010733a0b {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:07 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b8d49d48-3186-447b-b0f8-3e1010733a0b 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc847f5-bd45-4777-bde5-c2e55bd18ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4a55f1d-23b9-4174-ba36-8bacda32daf7', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:07 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b8d49d48-3186-447b-b0f8-3e1010733a0b 1073741824 Sep 07 14:04:07 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aca9aaf8-a721-476c-bd70-b56ad918089f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:07 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Volume volume-e4a55f1d-23b9-4174-ba36-8bacda32daf7 (e4a55f1d-23b9-4174-ba36-8bacda32daf7): created successfully Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aca9aaf8-a721-476c-bd70-b56ad918089f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Flow 'volume_create_manager' (05434f53-4237-4149-a455-caac81028742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:07 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-ac17f37e-a3dd-4109-afc9-cda433d16af1 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Created volume successfully. Sep 07 14:04:07 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD" returned: 1 in 0.334s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:04:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:08 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b8d49d48-3186-447b-b0f8-3e1010733a0b 1073741824" returned: 0 in 0.404s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8bbc153e-37a6-47db-8c98-cf97c44d2303 tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "cinder-091b016d-b79e-4fae-bc46-4af275678f2f-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b8d49d48-3186-447b-b0f8-3e1010733a0b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8bbc153e-37a6-47db-8c98-cf97c44d2303 tempest-CreateVolumesFromImageTest-158775323 None] Lock "cinder-091b016d-b79e-4fae-bc46-4af275678f2f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:08 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b8d49d48-3186-447b-b0f8-3e1010733a0b Sep 07 14:04:08 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8bbc153e-37a6-47db-8c98-cf97c44d2303 tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "cinder-quobyte-091b016d-b79e-4fae-bc46-4af275678f2f" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8bbc153e-37a6-47db-8c98-cf97c44d2303 tempest-CreateVolumesFromImageTest-158775323 None] Lock "cinder-quobyte-091b016d-b79e-4fae-bc46-4af275678f2f" acquired by "delete_volume" :: waited 0.014s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[811a030b-6d00-4daa-9a3f-ba4ca68fb3ac]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8bbc153e-37a6-47db-8c98-cf97c44d2303 tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-091b016d-b79e-4fae-bc46-4af275678f2f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:08 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-091b016d-b79e-4fae-bc46-4af275678f2f Sep 07 14:04:08 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:08 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b8d49d48-3186-447b-b0f8-3e1010733a0b" returned: 0 in 0.242s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.913s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1178959018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cece5f8-f2d9-4f85-ae3f-3629af635e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc400a4212e545b4acffe914ceec553a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:04Z,use_quota=True,user_id='cab0a25a6c7449478a82a593c33f1ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Creating volume 9cece5f8-f2d9-4f85-ae3f-3629af635e64 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:08 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9cece5f8-f2d9-4f85-ae3f-3629af635e64 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79bf27ab-0554-4638-b023-a51f70e447f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8d49d48-3186-447b-b0f8-3e1010733a0b', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9a0740-481e-4f34-bd70-300a58cf130c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:08 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9cece5f8-f2d9-4f85-ae3f-3629af635e64 1073741824 Sep 07 14:04:08 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:08 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Volume volume-b8d49d48-3186-447b-b0f8-3e1010733a0b (b8d49d48-3186-447b-b0f8-3e1010733a0b): created successfully Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9a0740-481e-4f34-bd70-300a58cf130c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Flow 'volume_create_manager' (233e786b-781d-4a90-abc7-5224ada36fdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:08 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-f17d60b6-b5e1-4d3e-8237-44d714d3af2b tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Created volume successfully. Sep 07 14:04:08 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8bbc153e-37a6-47db-8c98-cf97c44d2303 tempest-CreateVolumesFromImageTest-158775323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-091b016d-b79e-4fae-bc46-4af275678f2f" returned: 0 in 0.385s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8bbc153e-37a6-47db-8c98-cf97c44d2303 tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-091b016d-b79e-4fae-bc46-4af275678f2f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:08 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-091b016d-b79e-4fae-bc46-4af275678f2f Sep 07 14:04:08 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:08 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9cece5f8-f2d9-4f85-ae3f-3629af635e64 1073741824" returned: 0 in 0.430s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:08 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9cece5f8-f2d9-4f85-ae3f-3629af635e64 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8bbc153e-37a6-47db-8c98-cf97c44d2303 tempest-CreateVolumesFromImageTest-158775323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-091b016d-b79e-4fae-bc46-4af275678f2f" returned: 0 in 0.260s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:08 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9cece5f8-f2d9-4f85-ae3f-3629af635e64 Sep 07 14:04:08 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:08 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8bbc153e-37a6-47db-8c98-cf97c44d2303 tempest-CreateVolumesFromImageTest-158775323 None] Lock "cinder-quobyte-091b016d-b79e-4fae-bc46-4af275678f2f" released by "delete_volume" :: held 0.686s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-8bbc153e-37a6-47db-8c98-cf97c44d2303 tempest-CreateVolumesFromImageTest-158775323 None] Created reservations ['aa196b7a-9bd9-42c6-ac53-ba10fbfaa490', 'c8943f07-1ea8-447a-b7df-8f5350bb8f83', 'e2ea885e-4f2a-41f4-90b0-9737283e402c', 'ead2a347-deb8-4a9e-a033-299cb59d6f04'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8bbc153e-37a6-47db-8c98-cf97c44d2303 tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8bbc153e-37a6-47db-8c98-cf97c44d2303 tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8bbc153e-37a6-47db-8c98-cf97c44d2303 tempest-CreateVolumesFromImageTest-158775323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8bbc153e-37a6-47db-8c98-cf97c44d2303 tempest-CreateVolumesFromImageTest-158775323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8bbc153e-37a6-47db-8c98-cf97c44d2303 tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8bbc153e-37a6-47db-8c98-cf97c44d2303 tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:09 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:09 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:09 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9cece5f8-f2d9-4f85-ae3f-3629af635e64" returned: 0 in 0.237s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.072s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-771125886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeffd24c-d478-4b5e-80e0-7599eaec6909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc400a4212e545b4acffe914ceec553a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:05Z,use_quota=True,user_id='cab0a25a6c7449478a82a593c33f1ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Creating volume eeffd24c-d478-4b5e-80e0-7599eaec6909 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:09 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eeffd24c-d478-4b5e-80e0-7599eaec6909 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75373ade-a901-40a2-9fff-480344b62164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cece5f8-f2d9-4f85-ae3f-3629af635e64', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:09 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eeffd24c-d478-4b5e-80e0-7599eaec6909 1073741824 Sep 07 14:04:09 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8959ce-37b3-43c1-ad96-099e398cca1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:09 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Volume volume-9cece5f8-f2d9-4f85-ae3f-3629af635e64 (9cece5f8-f2d9-4f85-ae3f-3629af635e64): created successfully Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8959ce-37b3-43c1-ad96-099e398cca1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Flow 'volume_create_manager' (d1880056-45a3-4528-a4b9-5133673d016a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:09 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-efb4ee05-de96-4b83-b031-7346d593e4e9 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Created volume successfully. Sep 07 14:04:09 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c058bc1b-cdba-4f53-968e-7cde1a73f70c tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "cinder-145e5f72-6b67-4d32-bbe7-181146277b98-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8bbc153e-37a6-47db-8c98-cf97c44d2303 tempest-CreateVolumesFromImageTest-158775323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.270s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-8bbc153e-37a6-47db-8c98-cf97c44d2303 tempest-CreateVolumesFromImageTest-158775323 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:09 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-8bbc153e-37a6-47db-8c98-cf97c44d2303 tempest-CreateVolumesFromImageTest-158775323 None] Deleted volume successfully. Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c058bc1b-cdba-4f53-968e-7cde1a73f70c tempest-CreateVolumesFromImageTest-158775323 None] Lock "cinder-145e5f72-6b67-4d32-bbe7-181146277b98-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8bbc153e-37a6-47db-8c98-cf97c44d2303 tempest-CreateVolumesFromImageTest-158775323 None] Lock "cinder-091b016d-b79e-4fae-bc46-4af275678f2f-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c058bc1b-cdba-4f53-968e-7cde1a73f70c tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "cinder-quobyte-145e5f72-6b67-4d32-bbe7-181146277b98" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c058bc1b-cdba-4f53-968e-7cde1a73f70c tempest-CreateVolumesFromImageTest-158775323 None] Lock "cinder-quobyte-145e5f72-6b67-4d32-bbe7-181146277b98" acquired by "delete_volume" :: waited 0.014s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[064b3cb6-a371-4d19-85ff-0682b8e13a49]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c058bc1b-cdba-4f53-968e-7cde1a73f70c tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-145e5f72-6b67-4d32-bbe7-181146277b98 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:09 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-145e5f72-6b67-4d32-bbe7-181146277b98 Sep 07 14:04:09 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:09 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eeffd24c-d478-4b5e-80e0-7599eaec6909 1073741824" returned: 0 in 0.431s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eeffd24c-d478-4b5e-80e0-7599eaec6909 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:09 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eeffd24c-d478-4b5e-80e0-7599eaec6909 Sep 07 14:04:09 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:09 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c058bc1b-cdba-4f53-968e-7cde1a73f70c tempest-CreateVolumesFromImageTest-158775323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-145e5f72-6b67-4d32-bbe7-181146277b98" returned: 0 in 0.414s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c058bc1b-cdba-4f53-968e-7cde1a73f70c tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-145e5f72-6b67-4d32-bbe7-181146277b98 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:09 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-145e5f72-6b67-4d32-bbe7-181146277b98 Sep 07 14:04:09 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:09 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eeffd24c-d478-4b5e-80e0-7599eaec6909" returned: 0 in 0.255s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6c6f8b0c-fc68-4d8d-a8ed-c19c74c70262 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.014s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c38deba-0d0b-4dee-b576-c331efa6a9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeffd24c-d478-4b5e-80e0-7599eaec6909', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d06402-a116-4198-8fd9-8aab729abe7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-6c6f8b0c-fc68-4d8d-a8ed-c19c74c70262 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Creating offline snapshot 45129d7f-a076-4f70-a15b-97af03026ad1 of volume 50c2cd4b-50d3-47d4-8833-9df3e829bd35 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:04:09 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Volume volume-eeffd24c-d478-4b5e-80e0-7599eaec6909 (eeffd24c-d478-4b5e-80e0-7599eaec6909): created successfully Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d06402-a116-4198-8fd9-8aab729abe7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Flow 'volume_create_manager' (d1b7f9ad-d3fe-4016-9ab3-0de92d832d21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[62de8903-0cc6-4da6-acc7-fe56bd41b326]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6c6f8b0c-fc68-4d8d-a8ed-c19c74c70262 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:10 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-5405e8ca-5940-4c50-8402-da65f1961b6c tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Created volume successfully. Sep 07 14:04:10 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35 Sep 07 14:04:10 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:10 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c058bc1b-cdba-4f53-968e-7cde1a73f70c tempest-CreateVolumesFromImageTest-158775323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-145e5f72-6b67-4d32-bbe7-181146277b98" returned: 0 in 0.241s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c058bc1b-cdba-4f53-968e-7cde1a73f70c tempest-CreateVolumesFromImageTest-158775323 None] Lock "cinder-quobyte-145e5f72-6b67-4d32-bbe7-181146277b98" released by "delete_volume" :: held 0.697s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:10 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-c058bc1b-cdba-4f53-968e-7cde1a73f70c tempest-CreateVolumesFromImageTest-158775323 None] Created reservations ['7f4155fa-b08f-49da-9ebd-8439d7869395', '25f25884-61b4-43c3-bc6a-5ec13bc2f649', 'e9e5bcff-4dde-46c1-8f43-73d8f9a3535b', '7f013144-a744-4d5a-9e1a-c09c891d0fa8'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c058bc1b-cdba-4f53-968e-7cde1a73f70c tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c058bc1b-cdba-4f53-968e-7cde1a73f70c tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c058bc1b-cdba-4f53-968e-7cde1a73f70c tempest-CreateVolumesFromImageTest-158775323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c058bc1b-cdba-4f53-968e-7cde1a73f70c tempest-CreateVolumesFromImageTest-158775323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c058bc1b-cdba-4f53-968e-7cde1a73f70c tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c058bc1b-cdba-4f53-968e-7cde1a73f70c tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:10 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:10 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:10 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6c6f8b0c-fc68-4d8d-a8ed-c19c74c70262 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35" returned: 0 in 0.379s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6c6f8b0c-fc68-4d8d-a8ed-c19c74c70262 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.45129d7f-a076-4f70-a15b-97af03026ad1 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:10 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.45129d7f-a076-4f70-a15b-97af03026ad1 1G Sep 07 14:04:10 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:10 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c058bc1b-cdba-4f53-968e-7cde1a73f70c tempest-CreateVolumesFromImageTest-158775323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.252s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:10 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-c058bc1b-cdba-4f53-968e-7cde1a73f70c tempest-CreateVolumesFromImageTest-158775323 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:10 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c058bc1b-cdba-4f53-968e-7cde1a73f70c tempest-CreateVolumesFromImageTest-158775323 None] Deleted volume successfully. Sep 07 14:04:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6183de1c-1557-4b92-bbea-ba63de6fa54f tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "cinder-3928e805-3f06-402b-aade-a894057f726e-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c058bc1b-cdba-4f53-968e-7cde1a73f70c tempest-CreateVolumesFromImageTest-158775323 None] Lock "cinder-145e5f72-6b67-4d32-bbe7-181146277b98-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6183de1c-1557-4b92-bbea-ba63de6fa54f tempest-CreateVolumesFromImageTest-158775323 None] Lock "cinder-3928e805-3f06-402b-aade-a894057f726e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6183de1c-1557-4b92-bbea-ba63de6fa54f tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "cinder-quobyte-3928e805-3f06-402b-aade-a894057f726e" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6183de1c-1557-4b92-bbea-ba63de6fa54f tempest-CreateVolumesFromImageTest-158775323 None] Lock "cinder-quobyte-3928e805-3f06-402b-aade-a894057f726e" acquired by "delete_volume" :: waited 0.015s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:10 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5a999c-b07a-4e47-98d1-27d9064b2a1c]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6183de1c-1557-4b92-bbea-ba63de6fa54f tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3928e805-3f06-402b-aade-a894057f726e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:10 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3928e805-3f06-402b-aade-a894057f726e Sep 07 14:04:10 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:10 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6c6f8b0c-fc68-4d8d-a8ed-c19c74c70262 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.45129d7f-a076-4f70-a15b-97af03026ad1 1G" returned: 0 in 0.456s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6c6f8b0c-fc68-4d8d-a8ed-c19c74c70262 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.45129d7f-a076-4f70-a15b-97af03026ad1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:10 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.45129d7f-a076-4f70-a15b-97af03026ad1 Sep 07 14:04:10 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:11 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6183de1c-1557-4b92-bbea-ba63de6fa54f tempest-CreateVolumesFromImageTest-158775323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3928e805-3f06-402b-aade-a894057f726e" returned: 0 in 0.364s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6183de1c-1557-4b92-bbea-ba63de6fa54f tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3928e805-3f06-402b-aade-a894057f726e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:11 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3928e805-3f06-402b-aade-a894057f726e Sep 07 14:04:11 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:11 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6c6f8b0c-fc68-4d8d-a8ed-c19c74c70262 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.45129d7f-a076-4f70-a15b-97af03026ad1" returned: 0 in 0.299s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:11 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-6c6f8b0c-fc68-4d8d-a8ed-c19c74c70262 tempest-CreateVolumesFromSnapshotTest-1302931607 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.45129d7f-a076-4f70-a15b-97af03026ad1 is being set with open permissions: ugo+rw Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6c6f8b0c-fc68-4d8d-a8ed-c19c74c70262 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.45129d7f-a076-4f70-a15b-97af03026ad1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:11 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.45129d7f-a076-4f70-a15b-97af03026ad1 Sep 07 14:04:11 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:11 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6183de1c-1557-4b92-bbea-ba63de6fa54f tempest-CreateVolumesFromImageTest-158775323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3928e805-3f06-402b-aade-a894057f726e" returned: 0 in 0.251s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6183de1c-1557-4b92-bbea-ba63de6fa54f tempest-CreateVolumesFromImageTest-158775323 None] Lock "cinder-quobyte-3928e805-3f06-402b-aade-a894057f726e" released by "delete_volume" :: held 0.658s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-6183de1c-1557-4b92-bbea-ba63de6fa54f tempest-CreateVolumesFromImageTest-158775323 None] Created reservations ['9ad5fb55-2287-4c3d-a1a0-3cecf7a74a61', '54f32251-9a4f-4425-bfb2-a9b8b09741e3', 'dc4c2fe7-6851-4739-ad75-70089533040a', '95721fc7-626f-4967-b574-1facddc7da3d'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:11 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6c6f8b0c-fc68-4d8d-a8ed-c19c74c70262 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.45129d7f-a076-4f70-a15b-97af03026ad1" returned: 0 in 0.258s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6c6f8b0c-fc68-4d8d-a8ed-c19c74c70262 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:11 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.info Sep 07 14:04:11 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6183de1c-1557-4b92-bbea-ba63de6fa54f tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6183de1c-1557-4b92-bbea-ba63de6fa54f tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-6183de1c-1557-4b92-bbea-ba63de6fa54f tempest-CreateVolumesFromImageTest-158775323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-6183de1c-1557-4b92-bbea-ba63de6fa54f tempest-CreateVolumesFromImageTest-158775323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6183de1c-1557-4b92-bbea-ba63de6fa54f tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6183de1c-1557-4b92-bbea-ba63de6fa54f tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:11 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:11 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:11 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6c6f8b0c-fc68-4d8d-a8ed-c19c74c70262 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.info" returned: 0 in 0.263s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:11 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-6c6f8b0c-fc68-4d8d-a8ed-c19c74c70262 tempest-CreateVolumesFromSnapshotTest-1302931607 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.info is being set with open permissions: ugo+rw Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6c6f8b0c-fc68-4d8d-a8ed-c19c74c70262 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:11 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6183de1c-1557-4b92-bbea-ba63de6fa54f tempest-CreateVolumesFromImageTest-158775323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.253s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-6183de1c-1557-4b92-bbea-ba63de6fa54f tempest-CreateVolumesFromImageTest-158775323 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:11 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.info Sep 07 14:04:11 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:11 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-6183de1c-1557-4b92-bbea-ba63de6fa54f tempest-CreateVolumesFromImageTest-158775323 None] Deleted volume successfully. Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7b91c1c0-a77d-43ca-ba59-c838786c5ad3 tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "cinder-abf47a55-28f0-4438-a6ac-a2380d803b57-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6183de1c-1557-4b92-bbea-ba63de6fa54f tempest-CreateVolumesFromImageTest-158775323 None] Lock "cinder-3928e805-3f06-402b-aade-a894057f726e-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7b91c1c0-a77d-43ca-ba59-c838786c5ad3 tempest-CreateVolumesFromImageTest-158775323 None] Lock "cinder-abf47a55-28f0-4438-a6ac-a2380d803b57-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7b91c1c0-a77d-43ca-ba59-c838786c5ad3 tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "cinder-quobyte-abf47a55-28f0-4438-a6ac-a2380d803b57" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7b91c1c0-a77d-43ca-ba59-c838786c5ad3 tempest-CreateVolumesFromImageTest-158775323 None] Lock "cinder-quobyte-abf47a55-28f0-4438-a6ac-a2380d803b57" acquired by "delete_volume" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c9b905-3f72-4c95-9659-acd80d67e150]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7b91c1c0-a77d-43ca-ba59-c838786c5ad3 tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abf47a55-28f0-4438-a6ac-a2380d803b57 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:11 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abf47a55-28f0-4438-a6ac-a2380d803b57 Sep 07 14:04:11 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:12 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6c6f8b0c-fc68-4d8d-a8ed-c19c74c70262 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.info" returned: 0 in 0.316s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6c6f8b0c-fc68-4d8d-a8ed-c19c74c70262 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.122s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.025s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1358284278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f9fc81-d86f-4469-9c85-b5da0eec3f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc400a4212e545b4acffe914ceec553a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:06Z,use_quota=True,user_id='cab0a25a6c7449478a82a593c33f1ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Creating volume 11f9fc81-d86f-4469-9c85-b5da0eec3f9b {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:12 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-11f9fc81-d86f-4469-9c85-b5da0eec3f9b 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:12 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-11f9fc81-d86f-4469-9c85-b5da0eec3f9b 1073741824 Sep 07 14:04:12 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:12 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-6c6f8b0c-fc68-4d8d-a8ed-c19c74c70262 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Create snapshot completed successfully Sep 07 14:04:12 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7b91c1c0-a77d-43ca-ba59-c838786c5ad3 tempest-CreateVolumesFromImageTest-158775323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abf47a55-28f0-4438-a6ac-a2380d803b57" returned: 0 in 0.392s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7b91c1c0-a77d-43ca-ba59-c838786c5ad3 tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abf47a55-28f0-4438-a6ac-a2380d803b57 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:12 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abf47a55-28f0-4438-a6ac-a2380d803b57 Sep 07 14:04:12 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:12 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-11f9fc81-d86f-4469-9c85-b5da0eec3f9b 1073741824" returned: 0 in 0.447s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:12 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7b91c1c0-a77d-43ca-ba59-c838786c5ad3 tempest-CreateVolumesFromImageTest-158775323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-abf47a55-28f0-4438-a6ac-a2380d803b57" returned: 0 in 0.289s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7b91c1c0-a77d-43ca-ba59-c838786c5ad3 tempest-CreateVolumesFromImageTest-158775323 None] Lock "cinder-quobyte-abf47a55-28f0-4438-a6ac-a2380d803b57" released by "delete_volume" :: held 0.735s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-7b91c1c0-a77d-43ca-ba59-c838786c5ad3 tempest-CreateVolumesFromImageTest-158775323 None] Created reservations ['39a3ef2e-ecc5-4afc-99ac-82b391d98eef', '52df8d32-0eca-48a8-bf17-7320f995a1f2', '404dad07-4988-45fd-9ddf-6c31fbf35b77', '0a5d494b-c15b-44ec-973e-c933714ae5c8'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-11f9fc81-d86f-4469-9c85-b5da0eec3f9b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:12 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-11f9fc81-d86f-4469-9c85-b5da0eec3f9b Sep 07 14:04:12 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7b91c1c0-a77d-43ca-ba59-c838786c5ad3 tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7b91c1c0-a77d-43ca-ba59-c838786c5ad3 tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7b91c1c0-a77d-43ca-ba59-c838786c5ad3 tempest-CreateVolumesFromImageTest-158775323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7b91c1c0-a77d-43ca-ba59-c838786c5ad3 tempest-CreateVolumesFromImageTest-158775323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7b91c1c0-a77d-43ca-ba59-c838786c5ad3 tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7b91c1c0-a77d-43ca-ba59-c838786c5ad3 tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:12 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:12 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:12 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-11f9fc81-d86f-4469-9c85-b5da0eec3f9b" returned: 0 in 0.309s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.985s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f049aa09-3a03-47f2-96de-5fa13883c2f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8266ee66f264f08b441f6bb98794656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:06Z,use_quota=True,user_id='cbf0dad39a594a14b1cbffc7a79490eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06759d27-31f3-4b55-8c4a-bb244af8c610),volume_type_id=06759d27-31f3-4b55-8c4a-bb244af8c610)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Creating volume f049aa09-3a03-47f2-96de-5fa13883c2f8 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:12 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f049aa09-3a03-47f2-96de-5fa13883c2f8 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:12 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:12 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2c3a4d49-d98f-49b5-96cd-bd23a7bb1855 tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "cinder-9c51cbb5-01da-45ca-a426-4c5e2ff0b436-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7b91c1c0-a77d-43ca-ba59-c838786c5ad3 tempest-CreateVolumesFromImageTest-158775323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.294s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:13 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f049aa09-3a03-47f2-96de-5fa13883c2f8 1073741824 Sep 07 14:04:13 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-7b91c1c0-a77d-43ca-ba59-c838786c5ad3 tempest-CreateVolumesFromImageTest-158775323 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54715f96-6683-4947-9f2f-64c8d7001db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11f9fc81-d86f-4469-9c85-b5da0eec3f9b', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d453ee-7920-4b2f-8017-c70453b2649f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2c3a4d49-d98f-49b5-96cd-bd23a7bb1855 tempest-CreateVolumesFromImageTest-158775323 None] Lock "cinder-9c51cbb5-01da-45ca-a426-4c5e2ff0b436-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:13 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-7b91c1c0-a77d-43ca-ba59-c838786c5ad3 tempest-CreateVolumesFromImageTest-158775323 None] Deleted volume successfully. Sep 07 14:04:13 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Volume volume-11f9fc81-d86f-4469-9c85-b5da0eec3f9b (11f9fc81-d86f-4469-9c85-b5da0eec3f9b): created successfully Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d453ee-7920-4b2f-8017-c70453b2649f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Flow 'volume_create_manager' (1f5887f2-5b15-4012-a803-a4f24075f379) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:13 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-0aa5efd9-5414-4ad6-843f-bbbe423dd9df tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Created volume successfully. Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7b91c1c0-a77d-43ca-ba59-c838786c5ad3 tempest-CreateVolumesFromImageTest-158775323 None] Lock "cinder-abf47a55-28f0-4438-a6ac-a2380d803b57-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2c3a4d49-d98f-49b5-96cd-bd23a7bb1855 tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "cinder-quobyte-9c51cbb5-01da-45ca-a426-4c5e2ff0b436" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2c3a4d49-d98f-49b5-96cd-bd23a7bb1855 tempest-CreateVolumesFromImageTest-158775323 None] Lock "cinder-quobyte-9c51cbb5-01da-45ca-a426-4c5e2ff0b436" acquired by "delete_volume" :: waited 0.024s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0722a320-e03d-4896-86be-3a07927ab29e]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c3a4d49-d98f-49b5-96cd-bd23a7bb1855 tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c51cbb5-01da-45ca-a426-4c5e2ff0b436 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b504e19c-00f0-48b8-b610-faeba479164d tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "cinder-11f9fc81-d86f-4469-9c85-b5da0eec3f9b-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b504e19c-00f0-48b8-b610-faeba479164d tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-11f9fc81-d86f-4469-9c85-b5da0eec3f9b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:13 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c51cbb5-01da-45ca-a426-4c5e2ff0b436 Sep 07 14:04:13 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b504e19c-00f0-48b8-b610-faeba479164d tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "cinder-quobyte-11f9fc81-d86f-4469-9c85-b5da0eec3f9b" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b504e19c-00f0-48b8-b610-faeba479164d tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-quobyte-11f9fc81-d86f-4469-9c85-b5da0eec3f9b" acquired by "delete_volume" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70ca910-6d95-45f1-9b0c-93b32ad9b618]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b504e19c-00f0-48b8-b610-faeba479164d tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-11f9fc81-d86f-4469-9c85-b5da0eec3f9b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:13 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Flow 'volume_create_manager' (10247007-e2ee-4529-a5fc-285ccd0488fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:13 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-11f9fc81-d86f-4469-9c85-b5da0eec3f9b Sep 07 14:04:13 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1c434b-ba56-4e77-af91-542e7805bcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f049aa09-3a03-47f2-96de-5fa13883c2f8 1073741824" returned: 0 in 0.705s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1c434b-ba56-4e77-af91-542e7805bcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1131763297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98424d78-21c8-4899-821c-099adbf12e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc7e7396b4246aaa1eec58aac5ab826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:14Z,use_quota=True,user_id='240bb4ad61de46bb8b30de1ca47885e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c392f6ef-b501-406e-a1d1-cab6291424ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c392f6ef-b501-406e-a1d1-cab6291424ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0981ba-75a2-4c4d-8bc5-95f3bfc436f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0981ba-75a2-4c4d-8bc5-95f3bfc436f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98424d78-21c8-4899-821c-099adbf12e2e', 'volume_name': 'volume-98424d78-21c8-4899-821c-099adbf12e2e', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eccfad88-546a-4d7b-926d-ef6f70136d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eccfad88-546a-4d7b-926d-ef6f70136d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d307b2b6-c6ff-46a4-b6cd-a321fcccad2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:13 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Volume 98424d78-21c8-4899-821c-099adbf12e2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98424d78-21c8-4899-821c-099adbf12e2e', 'volume_size': 1} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:13 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f049aa09-3a03-47f2-96de-5fa13883c2f8 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c3a4d49-d98f-49b5-96cd-bd23a7bb1855 tempest-CreateVolumesFromImageTest-158775323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c51cbb5-01da-45ca-a426-4c5e2ff0b436" returned: 0 in 0.544s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c3a4d49-d98f-49b5-96cd-bd23a7bb1855 tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c51cbb5-01da-45ca-a426-4c5e2ff0b436 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:13 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f049aa09-3a03-47f2-96de-5fa13883c2f8 Sep 07 14:04:13 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:13 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c51cbb5-01da-45ca-a426-4c5e2ff0b436 Sep 07 14:04:13 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Flow 'volume_create_manager' (a1086246-abd2-4943-8e8d-fcc99c11db87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:14 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2c6494-2bc3-4051-b7e3-c2ffc30ecda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b504e19c-00f0-48b8-b610-faeba479164d tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-11f9fc81-d86f-4469-9c85-b5da0eec3f9b" returned: 0 in 0.622s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b504e19c-00f0-48b8-b610-faeba479164d tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-11f9fc81-d86f-4469-9c85-b5da0eec3f9b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:14 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2c6494-2bc3-4051-b7e3-c2ffc30ecda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-524496242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798e7152-b494-485a-932f-e806c8ebe91b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc7e7396b4246aaa1eec58aac5ab826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:14Z,use_quota=True,user_id='240bb4ad61de46bb8b30de1ca47885e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:14 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-11f9fc81-d86f-4469-9c85-b5da0eec3f9b Sep 07 14:04:14 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11184904-8b05-4f8c-ad61-d5cf16da85ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11184904-8b05-4f8c-ad61-d5cf16da85ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12c2a5b-6c89-46da-93f5-92c71373d8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12c2a5b-6c89-46da-93f5-92c71373d8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '798e7152-b494-485a-932f-e806c8ebe91b', 'volume_name': 'volume-798e7152-b494-485a-932f-e806c8ebe91b', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed49f2da-4a9d-415e-a69d-e2a160abbcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:14 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed49f2da-4a9d-415e-a69d-e2a160abbcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee6d677-b287-45e0-bc75-820b3cac1af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:14 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Volume 798e7152-b494-485a-932f-e806c8ebe91b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-798e7152-b494-485a-932f-e806c8ebe91b', 'volume_size': 1} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c3a4d49-d98f-49b5-96cd-bd23a7bb1855 tempest-CreateVolumesFromImageTest-158775323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9c51cbb5-01da-45ca-a426-4c5e2ff0b436" returned: 0 in 0.436s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f049aa09-3a03-47f2-96de-5fa13883c2f8" returned: 0 in 0.448s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.498s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1131763297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98424d78-21c8-4899-821c-099adbf12e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc7e7396b4246aaa1eec58aac5ab826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:14Z,use_quota=True,user_id='240bb4ad61de46bb8b30de1ca47885e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Creating volume 98424d78-21c8-4899-821c-099adbf12e2e {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:14 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-98424d78-21c8-4899-821c-099adbf12e2e 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:14 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-98424d78-21c8-4899-821c-099adbf12e2e 1073741824 Sep 07 14:04:14 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2c3a4d49-d98f-49b5-96cd-bd23a7bb1855 tempest-CreateVolumesFromImageTest-158775323 None] Lock "cinder-quobyte-9c51cbb5-01da-45ca-a426-4c5e2ff0b436" released by "delete_volume" :: held 1.116s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Attempting download of 3f50be0f-8804-476a-943f-d1a695f930e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/3f50be0f-8804-476a-943f-d1a695f930e0', 'metadata': {}}])) to volume f049aa09-3a03-47f2-96de-5fa13883c2f8. {{(pid=87571) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-2c3a4d49-d98f-49b5-96cd-bd23a7bb1855 tempest-CreateVolumesFromImageTest-158775323 None] Created reservations ['eca17bd3-b5a0-461c-a0c9-3ce56cea4ea9', '248729ad-2566-48ea-af49-85c85cb12c39', 'cde44733-de55-4cb6-91a0-1c92f75d5876', '00d6941b-48c3-4d30-894c-1626f1a0afc0'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c999ce-b488-4f78-a9aa-d527d4645765]: (4, 'raw') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f50be0f-8804-476a-943f-d1a695f930e0_4s6xzib_ {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:14 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b504e19c-00f0-48b8-b610-faeba479164d tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-11f9fc81-d86f-4469-9c85-b5da0eec3f9b" returned: 0 in 0.362s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b504e19c-00f0-48b8-b610-faeba479164d tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-quobyte-11f9fc81-d86f-4469-9c85-b5da0eec3f9b" released by "delete_volume" :: held 1.059s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:14 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f50be0f-8804-476a-943f-d1a695f930e0_4s6xzib_ Sep 07 14:04:14 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Flow 'volume_create_manager' (e44d7f30-968e-4c62-b659-0d1d47a19283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5375e845-6faa-494f-a9cb-bd74fda835bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5375e845-6faa-494f-a9cb-bd74fda835bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1011751123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35085d7-6da9-46d8-84e5-2a21d6202946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc7e7396b4246aaa1eec58aac5ab826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:15Z,use_quota=True,user_id='240bb4ad61de46bb8b30de1ca47885e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b5478c-ea23-4536-911b-81544e097860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b5478c-ea23-4536-911b-81544e097860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2053040c-7f0c-4c4b-83d8-39760755d869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2053040c-7f0c-4c4b-83d8-39760755d869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f35085d7-6da9-46d8-84e5-2a21d6202946', 'volume_name': 'volume-f35085d7-6da9-46d8-84e5-2a21d6202946', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b5e1970-d99a-41aa-a60d-77a8901e4b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b5e1970-d99a-41aa-a60d-77a8901e4b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18beb3bb-9005-4a10-a4ec-17aff3439fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:14 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Volume f35085d7-6da9-46d8-84e5-2a21d6202946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f35085d7-6da9-46d8-84e5-2a21d6202946', 'volume_size': 1} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2c3a4d49-d98f-49b5-96cd-bd23a7bb1855 tempest-CreateVolumesFromImageTest-158775323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2c3a4d49-d98f-49b5-96cd-bd23a7bb1855 tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2c3a4d49-d98f-49b5-96cd-bd23a7bb1855 tempest-CreateVolumesFromImageTest-158775323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2c3a4d49-d98f-49b5-96cd-bd23a7bb1855 tempest-CreateVolumesFromImageTest-158775323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2c3a4d49-d98f-49b5-96cd-bd23a7bb1855 tempest-CreateVolumesFromImageTest-158775323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c3a4d49-d98f-49b5-96cd-bd23a7bb1855 tempest-CreateVolumesFromImageTest-158775323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-b504e19c-00f0-48b8-b610-faeba479164d tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Created reservations ['c9100a06-a1ec-4c94-affe-4d371e653a65', '4e7e942c-582c-4448-a131-0626250c3dfd', '84de3a6e-6a10-4c1b-a783-8a2a06e5c85d', '2015a6a9-204a-41b5-a14d-bfaf3f71a1ec'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:14 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:14 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:14 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-98424d78-21c8-4899-821c-099adbf12e2e 1073741824" returned: 0 in 0.575s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b504e19c-00f0-48b8-b610-faeba479164d tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b504e19c-00f0-48b8-b610-faeba479164d tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b504e19c-00f0-48b8-b610-faeba479164d tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b504e19c-00f0-48b8-b610-faeba479164d tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b504e19c-00f0-48b8-b610-faeba479164d tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b504e19c-00f0-48b8-b610-faeba479164d tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-98424d78-21c8-4899-821c-099adbf12e2e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:14 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:14 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:14 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f50be0f-8804-476a-943f-d1a695f930e0_4s6xzib_" returned: 0 in 0.508s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f50be0f-8804-476a-943f-d1a695f930e0_4s6xzib_ {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:14 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-98424d78-21c8-4899-821c-099adbf12e2e Sep 07 14:04:14 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:15 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2c3a4d49-d98f-49b5-96cd-bd23a7bb1855 tempest-CreateVolumesFromImageTest-158775323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.326s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-2c3a4d49-d98f-49b5-96cd-bd23a7bb1855 tempest-CreateVolumesFromImageTest-158775323 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:15 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-2c3a4d49-d98f-49b5-96cd-bd23a7bb1855 tempest-CreateVolumesFromImageTest-158775323 None] Deleted volume successfully. Sep 07 14:04:15 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f50be0f-8804-476a-943f-d1a695f930e0_4s6xzib_ Sep 07 14:04:15 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2c3a4d49-d98f-49b5-96cd-bd23a7bb1855 tempest-CreateVolumesFromImageTest-158775323 None] Lock "cinder-9c51cbb5-01da-45ca-a426-4c5e2ff0b436-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Flow 'volume_create_manager' (a2c7c3dd-b109-4f2c-b535-4cd103707c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5582bbf-a3d3-4851-9955-f4b1372dd470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5582bbf-a3d3-4851-9955-f4b1372dd470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1486861742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=956ea70c-97cf-4209-a465-e54ed6d45f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc7e7396b4246aaa1eec58aac5ab826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:15Z,use_quota=True,user_id='240bb4ad61de46bb8b30de1ca47885e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (566f0633-a1cb-44b4-bc4b-ec2725325b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (566f0633-a1cb-44b4-bc4b-ec2725325b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (367c642a-7279-47ea-aa17-f914a5e50258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:15 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (367c642a-7279-47ea-aa17-f914a5e50258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '956ea70c-97cf-4209-a465-e54ed6d45f3f', 'volume_name': 'volume-956ea70c-97cf-4209-a465-e54ed6d45f3f', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99362f3b-e98b-4602-babb-6c88d135807b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99362f3b-e98b-4602-babb-6c88d135807b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:15 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff40fdb-625f-485b-ba82-600b812e7a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:15 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Volume 956ea70c-97cf-4209-a465-e54ed6d45f3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-956ea70c-97cf-4209-a465-e54ed6d45f3f', 'volume_size': 1} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-98424d78-21c8-4899-821c-099adbf12e2e" returned: 0 in 0.497s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:15 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.219s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-524496242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798e7152-b494-485a-932f-e806c8ebe91b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc7e7396b4246aaa1eec58aac5ab826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:14Z,use_quota=True,user_id='240bb4ad61de46bb8b30de1ca47885e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Creating volume 798e7152-b494-485a-932f-e806c8ebe91b {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:15 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-798e7152-b494-485a-932f-e806c8ebe91b 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b504e19c-00f0-48b8-b610-faeba479164d tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.565s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-b504e19c-00f0-48b8-b610-faeba479164d tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f50be0f-8804-476a-943f-d1a695f930e0_4s6xzib_" returned: 1 in 0.521s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f50be0f-8804-476a-943f-d1a695f930e0_4s6xzib_' failed. Not Retrying. {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d307b2b6-c6ff-46a4-b6cd-a321fcccad2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98424d78-21c8-4899-821c-099adbf12e2e', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96412fa1-ad78-438e-8514-298b8d24398e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:15 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-798e7152-b494-485a-932f-e806c8ebe91b 1073741824 Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8beacb-f2a5-415a-b296-f9191fe8c14e]: (4, 'raw') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:15 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-b504e19c-00f0-48b8-b610-faeba479164d tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Deleted volume successfully. Sep 07 14:04:15 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:15 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Volume volume-98424d78-21c8-4899-821c-099adbf12e2e (98424d78-21c8-4899-821c-099adbf12e2e): created successfully Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96412fa1-ad78-438e-8514-298b8d24398e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Flow 'volume_create_manager' (10247007-e2ee-4529-a5fc-285ccd0488fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b504e19c-00f0-48b8-b610-faeba479164d tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-11f9fc81-d86f-4469-9c85-b5da0eec3f9b-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:15 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-14b3a842-6a70-4344-8eee-a67ef4434bec tempest-CreateVolumesFromSnapshotTest-1302931607 None] Created volume successfully. Sep 07 14:04:15 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD Sep 07 14:04:15 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-980b1c7d-2cea-4fb0-bc71-3c3d25d25c1a tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "cinder-eeffd24c-d478-4b5e-80e0-7599eaec6909-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-980b1c7d-2cea-4fb0-bc71-3c3d25d25c1a tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-eeffd24c-d478-4b5e-80e0-7599eaec6909-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Flow 'volume_create_manager' (24d0c314-e58d-45ac-9422-24ac7816371b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b44355-e78a-44c3-92b3-aa1f89e23358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b44355-e78a-44c3-92b3-aa1f89e23358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1607801517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd74579-07af-4156-bbc3-4c899c84d037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc7e7396b4246aaa1eec58aac5ab826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:16Z,use_quota=True,user_id='240bb4ad61de46bb8b30de1ca47885e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e894cc-dbf7-4fcf-a371-1204c6ab03f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e894cc-dbf7-4fcf-a371-1204c6ab03f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4b5b679-4074-4114-a5af-0dc145523cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4b5b679-4074-4114-a5af-0dc145523cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fd74579-07af-4156-bbc3-4c899c84d037', 'volume_name': 'volume-1fd74579-07af-4156-bbc3-4c899c84d037', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49fe8b69-a306-4ede-88dc-b6b9ddd57a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49fe8b69-a306-4ede-88dc-b6b9ddd57a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aaf7789-0a42-434b-9d32-f47d0ef47526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:15 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Volume 1fd74579-07af-4156-bbc3-4c899c84d037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fd74579-07af-4156-bbc3-4c899c84d037', 'volume_size': 1} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-980b1c7d-2cea-4fb0-bc71-3c3d25d25c1a tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "cinder-quobyte-eeffd24c-d478-4b5e-80e0-7599eaec6909" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-980b1c7d-2cea-4fb0-bc71-3c3d25d25c1a tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-quobyte-eeffd24c-d478-4b5e-80e0-7599eaec6909" acquired by "delete_volume" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ce13be-7768-415e-bdae-b102086f2f25]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-980b1c7d-2cea-4fb0-bc71-3c3d25d25c1a tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eeffd24c-d478-4b5e-80e0-7599eaec6909 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:16 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD" returned: 0 in 0.549s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:16 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-798e7152-b494-485a-932f-e806c8ebe91b 1073741824" returned: 0 in 0.674s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:16 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eeffd24c-d478-4b5e-80e0-7599eaec6909 Sep 07 14:04:16 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:16 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD Sep 07 14:04:16 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-798e7152-b494-485a-932f-e806c8ebe91b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:16 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-798e7152-b494-485a-932f-e806c8ebe91b Sep 07 14:04:16 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:16 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] 3f50be0f-8804-476a-943f-d1a695f930e0 was raw, converting to qcow2 {{(pid=87571) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f049aa09-3a03-47f2-96de-5fa13883c2f8 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:16 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f049aa09-3a03-47f2-96de-5fa13883c2f8 Sep 07 14:04:16 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:16 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-798e7152-b494-485a-932f-e806c8ebe91b" returned: 0 in 0.323s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:16 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.778s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1011751123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35085d7-6da9-46d8-84e5-2a21d6202946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc7e7396b4246aaa1eec58aac5ab826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:15Z,use_quota=True,user_id='240bb4ad61de46bb8b30de1ca47885e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Creating volume f35085d7-6da9-46d8-84e5-2a21d6202946 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:16 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f35085d7-6da9-46d8-84e5-2a21d6202946 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-980b1c7d-2cea-4fb0-bc71-3c3d25d25c1a tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eeffd24c-d478-4b5e-80e0-7599eaec6909" returned: 0 in 0.509s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-980b1c7d-2cea-4fb0-bc71-3c3d25d25c1a tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eeffd24c-d478-4b5e-80e0-7599eaec6909 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:16 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f35085d7-6da9-46d8-84e5-2a21d6202946 1073741824 Sep 07 14:04:16 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee6d677-b287-45e0-bc75-820b3cac1af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-798e7152-b494-485a-932f-e806c8ebe91b', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfcc30f1-d9df-4687-a36e-944b1e0627af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:16 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eeffd24c-d478-4b5e-80e0-7599eaec6909 Sep 07 14:04:16 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:16 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Volume volume-798e7152-b494-485a-932f-e806c8ebe91b (798e7152-b494-485a-932f-e806c8ebe91b): created successfully Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfcc30f1-d9df-4687-a36e-944b1e0627af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Flow 'volume_create_manager' (a1086246-abd2-4943-8e8d-fcc99c11db87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:16 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-ef6d39e2-f977-402d-a1b8-a8c66f7a205e tempest-CreateVolumesFromSnapshotTest-1302931607 None] Created volume successfully. Sep 07 14:04:16 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-980b1c7d-2cea-4fb0-bc71-3c3d25d25c1a tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-eeffd24c-d478-4b5e-80e0-7599eaec6909" returned: 0 in 0.370s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-980b1c7d-2cea-4fb0-bc71-3c3d25d25c1a tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-quobyte-eeffd24c-d478-4b5e-80e0-7599eaec6909" released by "delete_volume" :: held 0.927s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:16 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-980b1c7d-2cea-4fb0-bc71-3c3d25d25c1a tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Created reservations ['5fbb2314-b8fe-4bd9-ad3a-36011e10092c', '1af4a982-d87a-4ab7-a9ab-abf4c3de4954', '667530f5-f123-4d45-a1a0-c3ac5fd1eee7', '55689acd-cff0-4f3a-906a-0dd8c74f220e'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:17 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f049aa09-3a03-47f2-96de-5fa13883c2f8" returned: 0 in 0.625s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3f50be0f-8804-476a-943f-d1a695f930e0_cm1ce24gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f049aa09-3a03-47f2-96de-5fa13883c2f8 {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 14:04:17 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f049aa09-3a03-47f2-96de-5fa13883c2f8 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:17 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f049aa09-3a03-47f2-96de-5fa13883c2f8 1G Sep 07 14:04:17 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-980b1c7d-2cea-4fb0-bc71-3c3d25d25c1a tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-980b1c7d-2cea-4fb0-bc71-3c3d25d25c1a tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-980b1c7d-2cea-4fb0-bc71-3c3d25d25c1a tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:17 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-980b1c7d-2cea-4fb0-bc71-3c3d25d25c1a tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-980b1c7d-2cea-4fb0-bc71-3c3d25d25c1a tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-980b1c7d-2cea-4fb0-bc71-3c3d25d25c1a tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f35085d7-6da9-46d8-84e5-2a21d6202946 1073741824" returned: 0 in 0.609s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:17 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:17 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f35085d7-6da9-46d8-84e5-2a21d6202946 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:17 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f35085d7-6da9-46d8-84e5-2a21d6202946 Sep 07 14:04:17 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:17 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f049aa09-3a03-47f2-96de-5fa13883c2f8 1G" returned: 0 in 0.368s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Downloaded image 3f50be0f-8804-476a-943f-d1a695f930e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/3f50be0f-8804-476a-943f-d1a695f930e0', 'metadata': {}}])) to volume f049aa09-3a03-47f2-96de-5fa13883c2f8 successfully. {{(pid=87571) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Temporary image 3f50be0f-8804-476a-943f-d1a695f930e0 for user cbf0dad39a594a14b1cbffc7a79490eb is deleted. {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Marking volume f049aa09-3a03-47f2-96de-5fa13883c2f8 as bootable. {{(pid=87571) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Copying metadata from image 3f50be0f-8804-476a-943f-d1a695f930e0 to f049aa09-3a03-47f2-96de-5fa13883c2f8. {{(pid=87571) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Creating volume glance metadata for volume f049aa09-3a03-47f2-96de-5fa13883c2f8 backed by image 3f50be0f-8804-476a-943f-d1a695f930e0 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3f50be0f-8804-476a-943f-d1a695f930e0', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '02370c5e4626c11a4a0200f1abcea491', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87571) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 14:04:17 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-980b1c7d-2cea-4fb0-bc71-3c3d25d25c1a tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.320s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-980b1c7d-2cea-4fb0-bc71-3c3d25d25c1a tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:17 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-980b1c7d-2cea-4fb0-bc71-3c3d25d25c1a tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Deleted volume successfully. Sep 07 14:04:17 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f35085d7-6da9-46d8-84e5-2a21d6202946" returned: 0 in 0.320s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.076s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1486861742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=956ea70c-97cf-4209-a465-e54ed6d45f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc7e7396b4246aaa1eec58aac5ab826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:15Z,use_quota=True,user_id='240bb4ad61de46bb8b30de1ca47885e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Creating volume 956ea70c-97cf-4209-a465-e54ed6d45f3f {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:17 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-956ea70c-97cf-4209-a465-e54ed6d45f3f 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18beb3bb-9005-4a10-a4ec-17aff3439fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f35085d7-6da9-46d8-84e5-2a21d6202946', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:17 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-956ea70c-97cf-4209-a465-e54ed6d45f3f 1073741824 Sep 07 14:04:17 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef043dc-3fce-4203-9c2c-0ebfbd26fcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-980b1c7d-2cea-4fb0-bc71-3c3d25d25c1a tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-eeffd24c-d478-4b5e-80e0-7599eaec6909-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:17 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Volume volume-f35085d7-6da9-46d8-84e5-2a21d6202946 (f35085d7-6da9-46d8-84e5-2a21d6202946): created successfully Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef043dc-3fce-4203-9c2c-0ebfbd26fcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Flow 'volume_create_manager' (e44d7f30-968e-4c62-b659-0d1d47a19283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:17 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-d6ad494c-3775-4351-af0d-0cb10573ba5f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Created volume successfully. Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7319d9-1ed4-4abf-ba32-5b38f130785b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f049aa09-3a03-47f2-96de-5fa13883c2f8', 'volume_size': 1, 'image_id': '3f50be0f-8804-476a-943f-d1a695f930e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f50be0f-8804-476a-943f-d1a695f930e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '02370c5e4626c11a4a0200f1abcea491', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e8266ee66f264f08b441f6bb98794656', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04e485fc87641a1183b1396f2ea97c3a5c6ab2960608145b9fdbbef0b96707429e169e1942a20f613919417f83201e8d5f6c8525b0b9870b205091a782c900b9', 'id': '3f50be0f-8804-476a-943f-d1a695f930e0', 'created_at': datetime.datetime(2026, 9, 7, 12, 4, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 12, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f50be0f-8804-476a-943f-d1a695f930e0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40843aa4-7013-4ee6-ac18-9fc431433090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:17 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Volume volume-f049aa09-3a03-47f2-96de-5fa13883c2f8 (f049aa09-3a03-47f2-96de-5fa13883c2f8): created successfully Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40843aa4-7013-4ee6-ac18-9fc431433090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Flow 'volume_create_manager' (7a37651e-f4de-4cfb-8ac4-d2c5a9e117ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:17 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-7988cab9-d7ab-45e4-be59-fd45fed72eec tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Created volume successfully. Sep 07 14:04:17 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-956ea70c-97cf-4209-a465-e54ed6d45f3f 1073741824" returned: 0 in 0.460s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-956ea70c-97cf-4209-a465-e54ed6d45f3f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:18 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-956ea70c-97cf-4209-a465-e54ed6d45f3f Sep 07 14:04:18 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-205e90e4-5705-43fe-8acc-078f56c3f56e tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "cinder-9cece5f8-f2d9-4f85-ae3f-3629af635e64-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-205e90e4-5705-43fe-8acc-078f56c3f56e tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-9cece5f8-f2d9-4f85-ae3f-3629af635e64-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-205e90e4-5705-43fe-8acc-078f56c3f56e tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "cinder-quobyte-9cece5f8-f2d9-4f85-ae3f-3629af635e64" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-205e90e4-5705-43fe-8acc-078f56c3f56e tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-quobyte-9cece5f8-f2d9-4f85-ae3f-3629af635e64" acquired by "delete_volume" :: waited 0.016s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b1b41d-bec0-4b21-86ef-6222fdd6d4b2]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-205e90e4-5705-43fe-8acc-078f56c3f56e tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9cece5f8-f2d9-4f85-ae3f-3629af635e64 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:18 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-956ea70c-97cf-4209-a465-e54ed6d45f3f" returned: 0 in 0.326s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.352s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1607801517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd74579-07af-4156-bbc3-4c899c84d037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc7e7396b4246aaa1eec58aac5ab826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:16Z,use_quota=True,user_id='240bb4ad61de46bb8b30de1ca47885e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Creating volume 1fd74579-07af-4156-bbc3-4c899c84d037 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:18 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9cece5f8-f2d9-4f85-ae3f-3629af635e64 Sep 07 14:04:18 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:18 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1fd74579-07af-4156-bbc3-4c899c84d037 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:18 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1fd74579-07af-4156-bbc3-4c899c84d037 1073741824 Sep 07 14:04:18 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff40fdb-625f-485b-ba82-600b812e7a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-956ea70c-97cf-4209-a465-e54ed6d45f3f', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f27629c-b93f-44b7-a2ff-f533f2f13a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:18 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Volume volume-956ea70c-97cf-4209-a465-e54ed6d45f3f (956ea70c-97cf-4209-a465-e54ed6d45f3f): created successfully Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f27629c-b93f-44b7-a2ff-f533f2f13a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Flow 'volume_create_manager' (a2c7c3dd-b109-4f2c-b535-4cd103707c14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:18 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-638e74e8-9a93-4c12-9a43-4ae18b59f8e2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Created volume successfully. Sep 07 14:04:18 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-205e90e4-5705-43fe-8acc-078f56c3f56e tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9cece5f8-f2d9-4f85-ae3f-3629af635e64" returned: 0 in 0.425s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-205e90e4-5705-43fe-8acc-078f56c3f56e tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9cece5f8-f2d9-4f85-ae3f-3629af635e64 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:18 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9cece5f8-f2d9-4f85-ae3f-3629af635e64 Sep 07 14:04:18 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-489b06b6-891c-46f8-876c-219a52d4ea08 tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Acquiring lock "cinder-f049aa09-3a03-47f2-96de-5fa13883c2f8-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-489b06b6-891c-46f8-876c-219a52d4ea08 tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Lock "cinder-f049aa09-3a03-47f2-96de-5fa13883c2f8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-489b06b6-891c-46f8-876c-219a52d4ea08 tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Acquiring lock "cinder-quobyte-f049aa09-3a03-47f2-96de-5fa13883c2f8" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-489b06b6-891c-46f8-876c-219a52d4ea08 tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Lock "cinder-quobyte-f049aa09-3a03-47f2-96de-5fa13883c2f8" acquired by "delete_volume" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[993ad3c0-4ba0-474d-ab33-79b61c0f1ac1]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-489b06b6-891c-46f8-876c-219a52d4ea08 tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f049aa09-3a03-47f2-96de-5fa13883c2f8 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:18 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1fd74579-07af-4156-bbc3-4c899c84d037 1073741824" returned: 0 in 0.534s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1fd74579-07af-4156-bbc3-4c899c84d037 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:18 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-205e90e4-5705-43fe-8acc-078f56c3f56e tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-9cece5f8-f2d9-4f85-ae3f-3629af635e64" returned: 0 in 0.296s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-205e90e4-5705-43fe-8acc-078f56c3f56e tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-quobyte-9cece5f8-f2d9-4f85-ae3f-3629af635e64" released by "delete_volume" :: held 0.779s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:18 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1fd74579-07af-4156-bbc3-4c899c84d037 Sep 07 14:04:18 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-205e90e4-5705-43fe-8acc-078f56c3f56e tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Created reservations ['62667b0e-84e3-4847-914d-8fce7b0c587d', 'c391550b-08d2-4c3a-93f7-d5bdadf8f2a3', '5d3eacde-acc8-4782-9eac-c7d6c6f9e49d', 'fae5e8b3-906a-49df-8fa0-ba0acb3ef943'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:19 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f049aa09-3a03-47f2-96de-5fa13883c2f8 Sep 07 14:04:19 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-205e90e4-5705-43fe-8acc-078f56c3f56e tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-205e90e4-5705-43fe-8acc-078f56c3f56e tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-205e90e4-5705-43fe-8acc-078f56c3f56e tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-205e90e4-5705-43fe-8acc-078f56c3f56e tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-205e90e4-5705-43fe-8acc-078f56c3f56e tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-205e90e4-5705-43fe-8acc-078f56c3f56e tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:19 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:19 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:19 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1fd74579-07af-4156-bbc3-4c899c84d037" returned: 0 in 0.372s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aaf7789-0a42-434b-9d32-f47d0ef47526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fd74579-07af-4156-bbc3-4c899c84d037', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (206f5a8a-cb23-43d4-9d9e-91d400b906f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f4dfacc2-d2ab-47ee-a80d-6c2d83ab5037 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "cinder-b8d49d48-3186-447b-b0f8-3e1010733a0b-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:19 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Volume volume-1fd74579-07af-4156-bbc3-4c899c84d037 (1fd74579-07af-4156-bbc3-4c899c84d037): created successfully Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (206f5a8a-cb23-43d4-9d9e-91d400b906f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Flow 'volume_create_manager' (24d0c314-e58d-45ac-9422-24ac7816371b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:19 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-e7d990af-3320-4862-9376-d9426eca1293 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Created volume successfully. Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f4dfacc2-d2ab-47ee-a80d-6c2d83ab5037 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-b8d49d48-3186-447b-b0f8-3e1010733a0b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:19 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-489b06b6-891c-46f8-876c-219a52d4ea08 tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f049aa09-3a03-47f2-96de-5fa13883c2f8" returned: 0 in 0.575s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-489b06b6-891c-46f8-876c-219a52d4ea08 tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f049aa09-3a03-47f2-96de-5fa13883c2f8 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:19 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f049aa09-3a03-47f2-96de-5fa13883c2f8 Sep 07 14:04:19 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f4dfacc2-d2ab-47ee-a80d-6c2d83ab5037 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "cinder-quobyte-b8d49d48-3186-447b-b0f8-3e1010733a0b" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f4dfacc2-d2ab-47ee-a80d-6c2d83ab5037 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-quobyte-b8d49d48-3186-447b-b0f8-3e1010733a0b" acquired by "delete_volume" :: waited 0.019s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:19 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-205e90e4-5705-43fe-8acc-078f56c3f56e tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.424s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-205e90e4-5705-43fe-8acc-078f56c3f56e tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:19 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-205e90e4-5705-43fe-8acc-078f56c3f56e tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Deleted volume successfully. Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd209841-1387-4e64-a7db-c237fd843ad2]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f4dfacc2-d2ab-47ee-a80d-6c2d83ab5037 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b8d49d48-3186-447b-b0f8-3e1010733a0b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-205e90e4-5705-43fe-8acc-078f56c3f56e tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-9cece5f8-f2d9-4f85-ae3f-3629af635e64-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:19 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b8d49d48-3186-447b-b0f8-3e1010733a0b Sep 07 14:04:19 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:19 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-489b06b6-891c-46f8-876c-219a52d4ea08 tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f049aa09-3a03-47f2-96de-5fa13883c2f8" returned: 0 in 0.313s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-489b06b6-891c-46f8-876c-219a52d4ea08 tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Lock "cinder-quobyte-f049aa09-3a03-47f2-96de-5fa13883c2f8" released by "delete_volume" :: held 0.932s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-489b06b6-891c-46f8-876c-219a52d4ea08 tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Created reservations ['b0e01328-259f-4586-abbd-0b27d7298237', 'a74994a2-5c06-4aab-8394-84724a4db66d', '41567604-fb82-4964-b68c-c15314669a48', '8f4290db-17f8-4be3-8498-221447c3d519'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-489b06b6-891c-46f8-876c-219a52d4ea08 tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-489b06b6-891c-46f8-876c-219a52d4ea08 tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-489b06b6-891c-46f8-876c-219a52d4ea08 tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-489b06b6-891c-46f8-876c-219a52d4ea08 tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-489b06b6-891c-46f8-876c-219a52d4ea08 tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-489b06b6-891c-46f8-876c-219a52d4ea08 tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:19 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:19 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:19 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f4dfacc2-d2ab-47ee-a80d-6c2d83ab5037 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b8d49d48-3186-447b-b0f8-3e1010733a0b" returned: 0 in 0.406s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f4dfacc2-d2ab-47ee-a80d-6c2d83ab5037 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b8d49d48-3186-447b-b0f8-3e1010733a0b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:19 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b8d49d48-3186-447b-b0f8-3e1010733a0b Sep 07 14:04:19 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:20 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-489b06b6-891c-46f8-876c-219a52d4ea08 tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.259s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-489b06b6-891c-46f8-876c-219a52d4ea08 tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:20 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-489b06b6-891c-46f8-876c-219a52d4ea08 tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Deleted volume successfully. Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-489b06b6-891c-46f8-876c-219a52d4ea08 tempest-VolumeAndVolumeTypeFromImageTest-1073244100 None] Lock "cinder-f049aa09-3a03-47f2-96de-5fa13883c2f8-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:20 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f4dfacc2-d2ab-47ee-a80d-6c2d83ab5037 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-b8d49d48-3186-447b-b0f8-3e1010733a0b" returned: 0 in 0.276s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f4dfacc2-d2ab-47ee-a80d-6c2d83ab5037 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-quobyte-b8d49d48-3186-447b-b0f8-3e1010733a0b" released by "delete_volume" :: held 0.744s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-f4dfacc2-d2ab-47ee-a80d-6c2d83ab5037 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Created reservations ['ddefe914-b82f-443f-a5da-94efa118af8a', '050bb850-c670-42f7-9a41-288f25c8331c', 'd1805ec9-e9ce-444e-90ef-2c071e723cf7', '654d3479-ffe2-4a44-a993-16788eadb957'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f4dfacc2-d2ab-47ee-a80d-6c2d83ab5037 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f4dfacc2-d2ab-47ee-a80d-6c2d83ab5037 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f4dfacc2-d2ab-47ee-a80d-6c2d83ab5037 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f4dfacc2-d2ab-47ee-a80d-6c2d83ab5037 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f4dfacc2-d2ab-47ee-a80d-6c2d83ab5037 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f4dfacc2-d2ab-47ee-a80d-6c2d83ab5037 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:20 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:20 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4261a384-30c6-42e4-a96b-dd48b5257546 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "cinder-1fd74579-07af-4156-bbc3-4c899c84d037-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4261a384-30c6-42e4-a96b-dd48b5257546 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-1fd74579-07af-4156-bbc3-4c899c84d037-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b72ea0aa-f490-49e8-b7e9-02386be274b6 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "cinder-e4a55f1d-23b9-4174-ba36-8bacda32daf7-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b72ea0aa-f490-49e8-b7e9-02386be274b6 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-e4a55f1d-23b9-4174-ba36-8bacda32daf7-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:20 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f4dfacc2-d2ab-47ee-a80d-6c2d83ab5037 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.268s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-f4dfacc2-d2ab-47ee-a80d-6c2d83ab5037 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4261a384-30c6-42e4-a96b-dd48b5257546 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "cinder-quobyte-1fd74579-07af-4156-bbc3-4c899c84d037" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:20 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-f4dfacc2-d2ab-47ee-a80d-6c2d83ab5037 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Deleted volume successfully. Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4261a384-30c6-42e4-a96b-dd48b5257546 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-quobyte-1fd74579-07af-4156-bbc3-4c899c84d037" acquired by "delete_volume" :: waited 0.034s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b72ea0aa-f490-49e8-b7e9-02386be274b6 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "cinder-quobyte-e4a55f1d-23b9-4174-ba36-8bacda32daf7" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f4dfacc2-d2ab-47ee-a80d-6c2d83ab5037 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-b8d49d48-3186-447b-b0f8-3e1010733a0b-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c8258c-b657-475f-9d70-a5e73db22959]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4261a384-30c6-42e4-a96b-dd48b5257546 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1fd74579-07af-4156-bbc3-4c899c84d037 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b72ea0aa-f490-49e8-b7e9-02386be274b6 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-quobyte-e4a55f1d-23b9-4174-ba36-8bacda32daf7" acquired by "delete_volume" :: waited 0.031s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7329f25f-aa7f-4abb-a12b-27f9520b72f9]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b72ea0aa-f490-49e8-b7e9-02386be274b6 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e4a55f1d-23b9-4174-ba36-8bacda32daf7 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:20 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1fd74579-07af-4156-bbc3-4c899c84d037 Sep 07 14:04:20 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:20 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e4a55f1d-23b9-4174-ba36-8bacda32daf7 Sep 07 14:04:20 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:21 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4261a384-30c6-42e4-a96b-dd48b5257546 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1fd74579-07af-4156-bbc3-4c899c84d037" returned: 0 in 0.407s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4261a384-30c6-42e4-a96b-dd48b5257546 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1fd74579-07af-4156-bbc3-4c899c84d037 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:21 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1fd74579-07af-4156-bbc3-4c899c84d037 Sep 07 14:04:21 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:21 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b72ea0aa-f490-49e8-b7e9-02386be274b6 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e4a55f1d-23b9-4174-ba36-8bacda32daf7" returned: 0 in 0.451s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b72ea0aa-f490-49e8-b7e9-02386be274b6 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e4a55f1d-23b9-4174-ba36-8bacda32daf7 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:21 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e4a55f1d-23b9-4174-ba36-8bacda32daf7 Sep 07 14:04:21 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:21 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4261a384-30c6-42e4-a96b-dd48b5257546 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1fd74579-07af-4156-bbc3-4c899c84d037" returned: 0 in 0.372s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4261a384-30c6-42e4-a96b-dd48b5257546 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-quobyte-1fd74579-07af-4156-bbc3-4c899c84d037" released by "delete_volume" :: held 0.841s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:21 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b72ea0aa-f490-49e8-b7e9-02386be274b6 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-e4a55f1d-23b9-4174-ba36-8bacda32daf7" returned: 0 in 0.321s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b72ea0aa-f490-49e8-b7e9-02386be274b6 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-quobyte-e4a55f1d-23b9-4174-ba36-8bacda32daf7" released by "delete_volume" :: held 0.833s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-4261a384-30c6-42e4-a96b-dd48b5257546 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Created reservations ['a6246032-6952-4e61-b79f-52dbd889fd62', '4e8cd1de-354c-47cc-9c17-1b342751cfef', 'a379e1f6-1eff-41ca-a9f6-bd7ac03eefc7', '0e2fda65-22ef-4d86-af16-ca54abd12840'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-b72ea0aa-f490-49e8-b7e9-02386be274b6 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Created reservations ['b4642f4e-6b6e-4372-8758-5580a4eba588', '4767b727-c4de-4228-89f6-5010dd8e12c4', 'a4c958c7-461d-4281-8d38-d464f401ad56', '6bbc5c0c-f411-4c63-b5cb-cd108904610c'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4261a384-30c6-42e4-a96b-dd48b5257546 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4261a384-30c6-42e4-a96b-dd48b5257546 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4261a384-30c6-42e4-a96b-dd48b5257546 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4261a384-30c6-42e4-a96b-dd48b5257546 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4261a384-30c6-42e4-a96b-dd48b5257546 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4261a384-30c6-42e4-a96b-dd48b5257546 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:21 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:21 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b72ea0aa-f490-49e8-b7e9-02386be274b6 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b72ea0aa-f490-49e8-b7e9-02386be274b6 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b72ea0aa-f490-49e8-b7e9-02386be274b6 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b72ea0aa-f490-49e8-b7e9-02386be274b6 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b72ea0aa-f490-49e8-b7e9-02386be274b6 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b72ea0aa-f490-49e8-b7e9-02386be274b6 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-65ec2469-e80b-4219-9c07-49dd3e64f9c5 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "cinder-49495391-0397-4f7b-9926-b028e088f9a9-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:21 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:21 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-65ec2469-e80b-4219-9c07-49dd3e64f9c5 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-49495391-0397-4f7b-9926-b028e088f9a9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-65ec2469-e80b-4219-9c07-49dd3e64f9c5 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "cinder-quobyte-49495391-0397-4f7b-9926-b028e088f9a9" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-65ec2469-e80b-4219-9c07-49dd3e64f9c5 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-quobyte-49495391-0397-4f7b-9926-b028e088f9a9" acquired by "delete_volume" :: waited 0.016s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6dc314-c633-488e-8430-61697c921ea8]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-65ec2469-e80b-4219-9c07-49dd3e64f9c5 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49495391-0397-4f7b-9926-b028e088f9a9 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:22 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4261a384-30c6-42e4-a96b-dd48b5257546 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.412s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-4261a384-30c6-42e4-a96b-dd48b5257546 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:22 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-4261a384-30c6-42e4-a96b-dd48b5257546 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Deleted volume successfully. Sep 07 14:04:22 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b72ea0aa-f490-49e8-b7e9-02386be274b6 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.380s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-b72ea0aa-f490-49e8-b7e9-02386be274b6 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:22 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49495391-0397-4f7b-9926-b028e088f9a9 Sep 07 14:04:22 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:22 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-b72ea0aa-f490-49e8-b7e9-02386be274b6 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Deleted volume successfully. Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4261a384-30c6-42e4-a96b-dd48b5257546 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-1fd74579-07af-4156-bbc3-4c899c84d037-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b72ea0aa-f490-49e8-b7e9-02386be274b6 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-e4a55f1d-23b9-4174-ba36-8bacda32daf7-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:22 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Flow 'volume_create_manager' (828a49b2-0b2f-4f5b-bc3c-ea93b935eaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56bc8e6-7fdd-4e09-bbf0-324f6ff9eec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-65ec2469-e80b-4219-9c07-49dd3e64f9c5 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49495391-0397-4f7b-9926-b028e088f9a9" returned: 0 in 0.562s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-65ec2469-e80b-4219-9c07-49dd3e64f9c5 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49495391-0397-4f7b-9926-b028e088f9a9 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:22 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49495391-0397-4f7b-9926-b028e088f9a9 Sep 07 14:04:22 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56bc8e6-7fdd-4e09-bbf0-324f6ff9eec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d500f4-4a59-4ae0-9bab-e9573e75b159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73842e6a662c4d21a1b2b3642e992cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:23Z,use_quota=True,user_id='5be8222a28e44e689e93168aee82064a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc60ecc-da2b-437a-b4c2-66fa44b2d427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc60ecc-da2b-437a-b4c2-66fa44b2d427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbcf62d9-aaaa-49de-aa65-41db986ec2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG cinder.image.glance [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Creating Keystone auth plugin from conf {{(pid=87571) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-569d6d5d-ba27-4932-9210-7845f2cf9204 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "cinder-956ea70c-97cf-4209-a465-e54ed6d45f3f-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-569d6d5d-ba27-4932-9210-7845f2cf9204 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-956ea70c-97cf-4209-a465-e54ed6d45f3f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:22 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-65ec2469-e80b-4219-9c07-49dd3e64f9c5 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-49495391-0397-4f7b-9926-b028e088f9a9" returned: 0 in 0.306s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-65ec2469-e80b-4219-9c07-49dd3e64f9c5 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-quobyte-49495391-0397-4f7b-9926-b028e088f9a9" released by "delete_volume" :: held 0.945s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-569d6d5d-ba27-4932-9210-7845f2cf9204 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "cinder-quobyte-956ea70c-97cf-4209-a465-e54ed6d45f3f" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:22 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-569d6d5d-ba27-4932-9210-7845f2cf9204 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-quobyte-956ea70c-97cf-4209-a465-e54ed6d45f3f" acquired by "delete_volume" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5864cb92-8d05-40ff-83c3-85ee344bc173]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-569d6d5d-ba27-4932-9210-7845f2cf9204 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-956ea70c-97cf-4209-a465-e54ed6d45f3f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-65ec2469-e80b-4219-9c07-49dd3e64f9c5 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Created reservations ['15e4d32e-a30c-4212-a645-f88d53d992bd', '9f687732-2fc7-4422-9196-f87618e1b159', '64d19d31-6a7b-45e6-8b7b-b6cdf2865506', '8ecfb845-1142-4463-a591-f33fc2ce4459'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbcf62d9-aaaa-49de-aa65-41db986ec2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c3d500f4-4a59-4ae0-9bab-e9573e75b159', 'volume_name': 'volume-c3d500f4-4a59-4ae0-9bab-e9573e75b159', 'volume_size': 1, 'image_id': '64cc9aec-a9c0-477a-bef1-257717f7ce14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64cc9aec-a9c0-477a-bef1-257717f7ce14', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7290ead8dc1b30f3d868a4c9a9e8242f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '73842e6a662c4d21a1b2b3642e992cad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '84c3cb1f2b714de4966986123f404f3a589c488b19313c37c3b748ed5f3609c5fa28372201f808745b6700cd3420e9d5b78540c9af6181f5060b3c7c5e61d8c3', 'id': '64cc9aec-a9c0-477a-bef1-257717f7ce14', 'created_at': datetime.datetime(2026, 9, 7, 12, 4, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 12, 4, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64cc9aec-a9c0-477a-bef1-257717f7ce14/file', 'properties': {}}, 'image_service': }' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (371d081b-b360-49f1-8f52-af975839e3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (371d081b-b360-49f1-8f52-af975839e3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79db3e51-a85c-423f-8cbd-41021931375e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:23 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Volume c3d500f4-4a59-4ae0-9bab-e9573e75b159: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c3d500f4-4a59-4ae0-9bab-e9573e75b159', 'volume_size': 1, 'image_id': '64cc9aec-a9c0-477a-bef1-257717f7ce14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64cc9aec-a9c0-477a-bef1-257717f7ce14', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7290ead8dc1b30f3d868a4c9a9e8242f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '73842e6a662c4d21a1b2b3642e992cad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '84c3cb1f2b714de4966986123f404f3a589c488b19313c37c3b748ed5f3609c5fa28372201f808745b6700cd3420e9d5b78540c9af6181f5060b3c7c5e61d8c3', 'id': '64cc9aec-a9c0-477a-bef1-257717f7ce14', 'created_at': datetime.datetime(2026, 9, 7, 12, 4, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 12, 4, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64cc9aec-a9c0-477a-bef1-257717f7ce14/file', 'properties': {}}, 'image_service': } Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Trying to clone c3d500f4-4a59-4ae0-9bab-e9573e75b159 from image 64cc9aec-a9c0-477a-bef1-257717f7ce14 at location (None, [{'url': 'file:///opt/stack/data/glance/images/64cc9aec-a9c0-477a-bef1-257717f7ce14', 'metadata': {}}]). {{(pid=87571) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1099}} Sep 07 14:04:23 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-956ea70c-97cf-4209-a465-e54ed6d45f3f Sep 07 14:04:23 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-65ec2469-e80b-4219-9c07-49dd3e64f9c5 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-65ec2469-e80b-4219-9c07-49dd3e64f9c5 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-65ec2469-e80b-4219-9c07-49dd3e64f9c5 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-65ec2469-e80b-4219-9c07-49dd3e64f9c5 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-65ec2469-e80b-4219-9c07-49dd3e64f9c5 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-65ec2469-e80b-4219-9c07-49dd3e64f9c5 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:23 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:23 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 14:04:23 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Image download 0.00 MB at 0.00 MB/s Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[788e051f-e490-4124-8b5b-830fae6c310f]: (4, 'raw') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:23 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-65ec2469-e80b-4219-9c07-49dd3e64f9c5 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.346s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:23 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD Sep 07 14:04:23 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-65ec2469-e80b-4219-9c07-49dd3e64f9c5 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:23 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-65ec2469-e80b-4219-9c07-49dd3e64f9c5 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Deleted volume successfully. Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-65ec2469-e80b-4219-9c07-49dd3e64f9c5 tempest-CreateVolumesFromSourceVolumeTest-306487952 None] Lock "cinder-49495391-0397-4f7b-9926-b028e088f9a9-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:23 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-569d6d5d-ba27-4932-9210-7845f2cf9204 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-956ea70c-97cf-4209-a465-e54ed6d45f3f" returned: 0 in 0.568s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-569d6d5d-ba27-4932-9210-7845f2cf9204 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-956ea70c-97cf-4209-a465-e54ed6d45f3f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:23 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-956ea70c-97cf-4209-a465-e54ed6d45f3f Sep 07 14:04:23 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:23 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:23 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-569d6d5d-ba27-4932-9210-7845f2cf9204 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-956ea70c-97cf-4209-a465-e54ed6d45f3f" returned: 0 in 0.268s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-569d6d5d-ba27-4932-9210-7845f2cf9204 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-quobyte-956ea70c-97cf-4209-a465-e54ed6d45f3f" released by "delete_volume" :: held 0.894s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:23 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD Sep 07 14:04:23 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:23 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-569d6d5d-ba27-4932-9210-7845f2cf9204 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Created reservations ['385680e3-7a37-48c4-bf79-a12312e8fb18', '0c4da26a-82e8-4e91-8f0a-b63df51f8b1e', '1fc7ae28-4e26-49a7-a574-f2355d0f339b', 'cc1ab0fc-29b9-4eb5-baf3-cdd973e50b7a'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-569d6d5d-ba27-4932-9210-7845f2cf9204 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-569d6d5d-ba27-4932-9210-7845f2cf9204 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-569d6d5d-ba27-4932-9210-7845f2cf9204 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-569d6d5d-ba27-4932-9210-7845f2cf9204 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-569d6d5d-ba27-4932-9210-7845f2cf9204 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-569d6d5d-ba27-4932-9210-7845f2cf9204 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:24 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:24 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:24 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD" returned: 1 in 0.421s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:04:24 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Temporary image 64cc9aec-a9c0-477a-bef1-257717f7ce14 is fetched for user 5be8222a28e44e689e93168aee82064a. {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 14:04:24 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3f9ef2-66cd-4139-a71c-f2810f8ce158]: (4, 'raw') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:24 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-569d6d5d-ba27-4932-9210-7845f2cf9204 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.314s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:24 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-569d6d5d-ba27-4932-9210-7845f2cf9204 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:24 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-569d6d5d-ba27-4932-9210-7845f2cf9204 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Deleted volume successfully. Sep 07 14:04:24 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-569d6d5d-ba27-4932-9210-7845f2cf9204 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-956ea70c-97cf-4209-a465-e54ed6d45f3f-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:24 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD Sep 07 14:04:24 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:24 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:24 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD Sep 07 14:04:24 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:25 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:04:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d500f4-4a59-4ae0-9bab-e9573e75b159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73842e6a662c4d21a1b2b3642e992cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:23Z,use_quota=True,user_id='5be8222a28e44e689e93168aee82064a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Creating volume c3d500f4-4a59-4ae0-9bab-e9573e75b159 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:25 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3d500f4-4a59-4ae0-9bab-e9573e75b159 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:25 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3d500f4-4a59-4ae0-9bab-e9573e75b159 1073741824 Sep 07 14:04:25 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dc11876b-2dcb-4854-863b-3efaabb35f2f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "cinder-f35085d7-6da9-46d8-84e5-2a21d6202946-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dc11876b-2dcb-4854-863b-3efaabb35f2f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-f35085d7-6da9-46d8-84e5-2a21d6202946-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dc11876b-2dcb-4854-863b-3efaabb35f2f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "cinder-quobyte-f35085d7-6da9-46d8-84e5-2a21d6202946" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:25 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dc11876b-2dcb-4854-863b-3efaabb35f2f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-quobyte-f35085d7-6da9-46d8-84e5-2a21d6202946" acquired by "delete_volume" :: waited 0.026s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:25 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b94b0a7-06bd-434e-a326-efe8d0bfb9fc]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dc11876b-2dcb-4854-863b-3efaabb35f2f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f35085d7-6da9-46d8-84e5-2a21d6202946 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:25 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f35085d7-6da9-46d8-84e5-2a21d6202946 Sep 07 14:04:25 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:25 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3d500f4-4a59-4ae0-9bab-e9573e75b159 1073741824" returned: 0 in 0.589s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3d500f4-4a59-4ae0-9bab-e9573e75b159 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:25 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3d500f4-4a59-4ae0-9bab-e9573e75b159 Sep 07 14:04:25 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:25 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dc11876b-2dcb-4854-863b-3efaabb35f2f tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f35085d7-6da9-46d8-84e5-2a21d6202946" returned: 0 in 0.477s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dc11876b-2dcb-4854-863b-3efaabb35f2f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f35085d7-6da9-46d8-84e5-2a21d6202946 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:25 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f35085d7-6da9-46d8-84e5-2a21d6202946 Sep 07 14:04:25 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:26 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3d500f4-4a59-4ae0-9bab-e9573e75b159" returned: 0 in 0.292s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Attempting download of 64cc9aec-a9c0-477a-bef1-257717f7ce14 ((None, [{'url': 'file:///opt/stack/data/glance/images/64cc9aec-a9c0-477a-bef1-257717f7ce14', 'metadata': {}}])) to volume c3d500f4-4a59-4ae0-9bab-e9573e75b159. {{(pid=87571) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 14:04:26 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dc11876b-2dcb-4854-863b-3efaabb35f2f tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-f35085d7-6da9-46d8-84e5-2a21d6202946" returned: 0 in 0.298s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dc11876b-2dcb-4854-863b-3efaabb35f2f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-quobyte-f35085d7-6da9-46d8-84e5-2a21d6202946" released by "delete_volume" :: held 0.828s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[def87729-4bf0-48a4-aaea-7aa02b33384b]: (4, 'raw') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64cc9aec-a9c0-477a-bef1-257717f7ce14_izh8yuw4 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-dc11876b-2dcb-4854-863b-3efaabb35f2f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Created reservations ['bbeb9612-0392-48e3-9661-aaac18375a1b', '9af77fef-5521-40a7-9ff8-008e67e0ee16', 'a4798fe7-b506-48da-ade8-ea3d7f04506f', '6b73e769-c6a6-452d-9b55-599d741ece05'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:26 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64cc9aec-a9c0-477a-bef1-257717f7ce14_izh8yuw4 Sep 07 14:04:26 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-dc11876b-2dcb-4854-863b-3efaabb35f2f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-dc11876b-2dcb-4854-863b-3efaabb35f2f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-dc11876b-2dcb-4854-863b-3efaabb35f2f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-dc11876b-2dcb-4854-863b-3efaabb35f2f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-dc11876b-2dcb-4854-863b-3efaabb35f2f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dc11876b-2dcb-4854-863b-3efaabb35f2f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:26 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:26 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7a4ca8a9-a76d-4fcc-b81f-a501c41809c1 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "cinder-798e7152-b494-485a-932f-e806c8ebe91b-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7a4ca8a9-a76d-4fcc-b81f-a501c41809c1 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-798e7152-b494-485a-932f-e806c8ebe91b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7a4ca8a9-a76d-4fcc-b81f-a501c41809c1 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "cinder-quobyte-798e7152-b494-485a-932f-e806c8ebe91b" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7a4ca8a9-a76d-4fcc-b81f-a501c41809c1 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-quobyte-798e7152-b494-485a-932f-e806c8ebe91b" acquired by "delete_volume" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:26 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64cc9aec-a9c0-477a-bef1-257717f7ce14_izh8yuw4" returned: 0 in 0.437s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64cc9aec-a9c0-477a-bef1-257717f7ce14_izh8yuw4 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77a02f0-39e3-428b-aa84-8458c5eadb9a]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7a4ca8a9-a76d-4fcc-b81f-a501c41809c1 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-798e7152-b494-485a-932f-e806c8ebe91b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:26 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dc11876b-2dcb-4854-863b-3efaabb35f2f tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.386s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-dc11876b-2dcb-4854-863b-3efaabb35f2f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:26 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64cc9aec-a9c0-477a-bef1-257717f7ce14_izh8yuw4 Sep 07 14:04:26 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:26 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-dc11876b-2dcb-4854-863b-3efaabb35f2f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Deleted volume successfully. Sep 07 14:04:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dc11876b-2dcb-4854-863b-3efaabb35f2f tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-f35085d7-6da9-46d8-84e5-2a21d6202946-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:26 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-798e7152-b494-485a-932f-e806c8ebe91b Sep 07 14:04:26 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:27 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64cc9aec-a9c0-477a-bef1-257717f7ce14_izh8yuw4" returned: 1 in 0.446s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64cc9aec-a9c0-477a-bef1-257717f7ce14_izh8yuw4' failed. Not Retrying. {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:04:27 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[49055c58-f2fa-4886-a254-5bbd26005fcf]: (4, 'raw') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:27 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7a4ca8a9-a76d-4fcc-b81f-a501c41809c1 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-798e7152-b494-485a-932f-e806c8ebe91b" returned: 0 in 0.595s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7a4ca8a9-a76d-4fcc-b81f-a501c41809c1 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-798e7152-b494-485a-932f-e806c8ebe91b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:27 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD Sep 07 14:04:27 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:27 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-798e7152-b494-485a-932f-e806c8ebe91b Sep 07 14:04:27 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:27 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:27 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD Sep 07 14:04:27 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:27 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7a4ca8a9-a76d-4fcc-b81f-a501c41809c1 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-798e7152-b494-485a-932f-e806c8ebe91b" returned: 0 in 0.464s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:27 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7a4ca8a9-a76d-4fcc-b81f-a501c41809c1 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-quobyte-798e7152-b494-485a-932f-e806c8ebe91b" released by "delete_volume" :: held 1.120s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:27 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-7a4ca8a9-a76d-4fcc-b81f-a501c41809c1 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Created reservations ['3d96a12d-2dba-438d-acd9-ae696440c7f6', 'c049c598-b6c3-4d9d-8ab1-f384b1ad3589', '4c5d9dfa-4f59-442d-b502-deb60578d8c7', '8eb0ac25-6900-4498-b685-d01922c16d19'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7a4ca8a9-a76d-4fcc-b81f-a501c41809c1 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7a4ca8a9-a76d-4fcc-b81f-a501c41809c1 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:27 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7a4ca8a9-a76d-4fcc-b81f-a501c41809c1 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:27 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-7a4ca8a9-a76d-4fcc-b81f-a501c41809c1 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7a4ca8a9-a76d-4fcc-b81f-a501c41809c1 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7a4ca8a9-a76d-4fcc-b81f-a501c41809c1 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:27 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:27 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:27 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD" returned: 1 in 0.448s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:04:27 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] 64cc9aec-a9c0-477a-bef1-257717f7ce14 was raw, converting to qcow2 {{(pid=87571) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 14:04:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3d500f4-4a59-4ae0-9bab-e9573e75b159 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:27 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3d500f4-4a59-4ae0-9bab-e9573e75b159 Sep 07 14:04:27 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:28 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7a4ca8a9-a76d-4fcc-b81f-a501c41809c1 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.315s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-7a4ca8a9-a76d-4fcc-b81f-a501c41809c1 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:28 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-7a4ca8a9-a76d-4fcc-b81f-a501c41809c1 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Deleted volume successfully. Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7a4ca8a9-a76d-4fcc-b81f-a501c41809c1 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-798e7152-b494-485a-932f-e806c8ebe91b-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:28 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:28 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:28 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Flow 'volume_create_manager' (c06dde75-60a9-4315-9bb2-cc73ed03fd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (710c636d-b35a-4e68-9c90-2a97e7b53d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3d500f4-4a59-4ae0-9bab-e9573e75b159" returned: 0 in 0.586s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_64cc9aec-a9c0-477a-bef1-257717f7ce14_svtdwa6idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3d500f4-4a59-4ae0-9bab-e9573e75b159 {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 14:04:28 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3d500f4-4a59-4ae0-9bab-e9573e75b159 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (710c636d-b35a-4e68-9c90-2a97e7b53d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1181892800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c4a357-3436-47aa-9d17-aba85bdaf577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8fd9674bb249b899d5c69373880941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:28Z,use_quota=True,user_id='30c462f1a0094053b9f39392ba6e3442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:28 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3d500f4-4a59-4ae0-9bab-e9573e75b159 1G Sep 07 14:04:28 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9025971-9243-4b3b-8b51-7c208f0fd0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9025971-9243-4b3b-8b51-7c208f0fd0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bde984-88a4-44bd-86af-658896307fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bde984-88a4-44bd-86af-658896307fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46c4a357-3436-47aa-9d17-aba85bdaf577', 'volume_name': 'volume-46c4a357-3436-47aa-9d17-aba85bdaf577', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffbc66d-3641-4eb7-9ffc-c59780510114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffbc66d-3641-4eb7-9ffc-c59780510114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66445e42-cebc-4126-b5d2-2595f4891836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:28 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Volume 46c4a357-3436-47aa-9d17-aba85bdaf577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46c4a357-3436-47aa-9d17-aba85bdaf577', 'volume_size': 1} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1181892800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c4a357-3436-47aa-9d17-aba85bdaf577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8fd9674bb249b899d5c69373880941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:28Z,use_quota=True,user_id='30c462f1a0094053b9f39392ba6e3442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Creating volume 46c4a357-3436-47aa-9d17-aba85bdaf577 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:28 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:28 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.303s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager._thread_info {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread count: 28 {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 14:04:28 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577 1073741824 Sep 07 14:04:28 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread info: [<_MainThread(MainThread, started 132147689414784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d118ea51-79d7-4bda-a3f3-fbd94b866788 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "cinder-98424d78-21c8-4899-821c-099adbf12e2e-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d118ea51-79d7-4bda-a3f3-fbd94b866788 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-98424d78-21c8-4899-821c-099adbf12e2e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d118ea51-79d7-4bda-a3f3-fbd94b866788 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "cinder-quobyte-98424d78-21c8-4899-821c-099adbf12e2e" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d118ea51-79d7-4bda-a3f3-fbd94b866788 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-quobyte-98424d78-21c8-4899-821c-099adbf12e2e" acquired by "delete_volume" :: waited 0.030s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab910ca-4ba6-4134-be1d-62ecacd0a837]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d118ea51-79d7-4bda-a3f3-fbd94b866788 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-98424d78-21c8-4899-821c-099adbf12e2e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:28 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3d500f4-4a59-4ae0-9bab-e9573e75b159 1G" returned: 0 in 0.467s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Downloaded image 64cc9aec-a9c0-477a-bef1-257717f7ce14 ((None, [{'url': 'file:///opt/stack/data/glance/images/64cc9aec-a9c0-477a-bef1-257717f7ce14', 'metadata': {}}])) to volume c3d500f4-4a59-4ae0-9bab-e9573e75b159 successfully. {{(pid=87571) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Temporary image 64cc9aec-a9c0-477a-bef1-257717f7ce14 for user 5be8222a28e44e689e93168aee82064a is deleted. {{(pid=87571) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.volume.volume_utils [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Marking volume c3d500f4-4a59-4ae0-9bab-e9573e75b159 as bootable. {{(pid=87571) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Copying metadata from image 64cc9aec-a9c0-477a-bef1-257717f7ce14 to c3d500f4-4a59-4ae0-9bab-e9573e75b159. {{(pid=87571) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Creating volume glance metadata for volume c3d500f4-4a59-4ae0-9bab-e9573e75b159 backed by image 64cc9aec-a9c0-477a-bef1-257717f7ce14 with: {'image_id': '64cc9aec-a9c0-477a-bef1-257717f7ce14', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7290ead8dc1b30f3d868a4c9a9e8242f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87571) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 14:04:29 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-98424d78-21c8-4899-821c-099adbf12e2e Sep 07 14:04:29 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79db3e51-a85c-423f-8cbd-41021931375e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3d500f4-4a59-4ae0-9bab-e9573e75b159', 'volume_size': 1, 'image_id': '64cc9aec-a9c0-477a-bef1-257717f7ce14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64cc9aec-a9c0-477a-bef1-257717f7ce14', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7290ead8dc1b30f3d868a4c9a9e8242f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '73842e6a662c4d21a1b2b3642e992cad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '84c3cb1f2b714de4966986123f404f3a589c488b19313c37c3b748ed5f3609c5fa28372201f808745b6700cd3420e9d5b78540c9af6181f5060b3c7c5e61d8c3', 'id': '64cc9aec-a9c0-477a-bef1-257717f7ce14', 'created_at': datetime.datetime(2026, 9, 7, 12, 4, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 12, 4, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64cc9aec-a9c0-477a-bef1-257717f7ce14/file', 'properties': {}}, 'image_service': }' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae3fe18-4331-4210-ade3-ff64c96d64a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:29 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Volume volume-c3d500f4-4a59-4ae0-9bab-e9573e75b159 (c3d500f4-4a59-4ae0-9bab-e9573e75b159): created successfully Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae3fe18-4331-4210-ade3-ff64c96d64a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Flow 'volume_create_manager' (828a49b2-0b2f-4f5b-bc3c-ea93b935eaa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:29 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-8a213969-e0bb-4498-9a39-87f6a53a7854 tempest-VolumeImageDependencyTests-2059485052 None] Created volume successfully. Sep 07 14:04:29 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577 1073741824" returned: 0 in 0.624s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:29 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577 Sep 07 14:04:29 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:29 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d118ea51-79d7-4bda-a3f3-fbd94b866788 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-98424d78-21c8-4899-821c-099adbf12e2e" returned: 0 in 0.466s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d118ea51-79d7-4bda-a3f3-fbd94b866788 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-98424d78-21c8-4899-821c-099adbf12e2e {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:29 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-98424d78-21c8-4899-821c-099adbf12e2e Sep 07 14:04:29 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:29 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577" returned: 0 in 0.280s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66445e42-cebc-4126-b5d2-2595f4891836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46c4a357-3436-47aa-9d17-aba85bdaf577', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82be6ca-6988-4515-85a2-4625ed365aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:29 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Volume volume-46c4a357-3436-47aa-9d17-aba85bdaf577 (46c4a357-3436-47aa-9d17-aba85bdaf577): created successfully Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82be6ca-6988-4515-85a2-4625ed365aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Flow 'volume_create_manager' (c06dde75-60a9-4315-9bb2-cc73ed03fd5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:29 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-351fb2a1-f9f0-44a7-9b38-5fe467bb38f9 tempest-ProjectMemberTests-1858363890 None] Created volume successfully. Sep 07 14:04:29 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d118ea51-79d7-4bda-a3f3-fbd94b866788 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-98424d78-21c8-4899-821c-099adbf12e2e" returned: 0 in 0.329s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d118ea51-79d7-4bda-a3f3-fbd94b866788 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-quobyte-98424d78-21c8-4899-821c-099adbf12e2e" released by "delete_volume" :: held 0.838s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-d118ea51-79d7-4bda-a3f3-fbd94b866788 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Created reservations ['f6a6775a-3094-4cdc-86de-dafce9dc1d20', '8e0d440e-4442-4898-9c00-76f0327d8a67', '9a56f1ba-41ce-4787-844a-ff4622ec8c28', 'f784b1ce-ea96-41be-b487-e86d1c4c28d8'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d118ea51-79d7-4bda-a3f3-fbd94b866788 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d118ea51-79d7-4bda-a3f3-fbd94b866788 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d118ea51-79d7-4bda-a3f3-fbd94b866788 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d118ea51-79d7-4bda-a3f3-fbd94b866788 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d118ea51-79d7-4bda-a3f3-fbd94b866788 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d118ea51-79d7-4bda-a3f3-fbd94b866788 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:29 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:29 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6545a44f-6c68-40b3-b347-df5e8a2cc163 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "cinder-45129d7f-a076-4f70-a15b-97af03026ad1-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6545a44f-6c68-40b3-b347-df5e8a2cc163 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-45129d7f-a076-4f70-a15b-97af03026ad1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6545a44f-6c68-40b3-b347-df5e8a2cc163 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "cinder-quobyte-50c2cd4b-50d3-47d4-8833-9df3e829bd35" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6545a44f-6c68-40b3-b347-df5e8a2cc163 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-quobyte-50c2cd4b-50d3-47d4-8833-9df3e829bd35" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6545a44f-6c68-40b3-b347-df5e8a2cc163 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "cinder-quobyte-45129d7f-a076-4f70-a15b-97af03026ad1" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6545a44f-6c68-40b3-b347-df5e8a2cc163 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-quobyte-45129d7f-a076-4f70-a15b-97af03026ad1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-6545a44f-6c68-40b3-b347-df5e8a2cc163 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Deleting offline snapshot 45129d7f-a076-4f70-a15b-97af03026ad1 of volume 50c2cd4b-50d3-47d4-8833-9df3e829bd35 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:04:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-6545a44f-6c68-40b3-b347-df5e8a2cc163 tempest-CreateVolumesFromSnapshotTest-1302931607 None] snapshot_file for this snap is: volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.45129d7f-a076-4f70-a15b-97af03026ad1 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:04:30 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5587a430-9eea-4ef4-919f-6632b9fa8133]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6545a44f-6c68-40b3-b347-df5e8a2cc163 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.45129d7f-a076-4f70-a15b-97af03026ad1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:30 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d118ea51-79d7-4bda-a3f3-fbd94b866788 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.284s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:30 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-d118ea51-79d7-4bda-a3f3-fbd94b866788 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:30 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-d118ea51-79d7-4bda-a3f3-fbd94b866788 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Deleted volume successfully. Sep 07 14:04:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-d118ea51-79d7-4bda-a3f3-fbd94b866788 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-98424d78-21c8-4899-821c-099adbf12e2e-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:30 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.45129d7f-a076-4f70-a15b-97af03026ad1 Sep 07 14:04:30 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8039734e-0d83-415a-83b6-c080f920bcdd tempest-VolumeImageDependencyTests-2059485052 None] Acquiring lock "cinder-c3d500f4-4a59-4ae0-9bab-e9573e75b159-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8039734e-0d83-415a-83b6-c080f920bcdd tempest-VolumeImageDependencyTests-2059485052 None] Lock "cinder-c3d500f4-4a59-4ae0-9bab-e9573e75b159-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8039734e-0d83-415a-83b6-c080f920bcdd tempest-VolumeImageDependencyTests-2059485052 None] Acquiring lock "cinder-quobyte-c3d500f4-4a59-4ae0-9bab-e9573e75b159" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8039734e-0d83-415a-83b6-c080f920bcdd tempest-VolumeImageDependencyTests-2059485052 None] Lock "cinder-quobyte-c3d500f4-4a59-4ae0-9bab-e9573e75b159" acquired by "delete_volume" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:30 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0494c3-51dd-4b48-ba46-ee2fd210d18d]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8039734e-0d83-415a-83b6-c080f920bcdd tempest-VolumeImageDependencyTests-2059485052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3d500f4-4a59-4ae0-9bab-e9573e75b159 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:30 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3d500f4-4a59-4ae0-9bab-e9573e75b159 Sep 07 14:04:30 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:30 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6545a44f-6c68-40b3-b347-df5e8a2cc163 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.45129d7f-a076-4f70-a15b-97af03026ad1" returned: 0 in 0.545s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-6545a44f-6c68-40b3-b347-df5e8a2cc163 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:04:30 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ad554f-a9a7-4e8a-a2b5-847d739b8466]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6545a44f-6c68-40b3-b347-df5e8a2cc163 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:30 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35 Sep 07 14:04:30 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:30 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8039734e-0d83-415a-83b6-c080f920bcdd tempest-VolumeImageDependencyTests-2059485052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3d500f4-4a59-4ae0-9bab-e9573e75b159" returned: 0 in 0.413s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8039734e-0d83-415a-83b6-c080f920bcdd tempest-VolumeImageDependencyTests-2059485052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3d500f4-4a59-4ae0-9bab-e9573e75b159 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:30 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3d500f4-4a59-4ae0-9bab-e9573e75b159 Sep 07 14:04:30 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:31 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6545a44f-6c68-40b3-b347-df5e8a2cc163 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35" returned: 0 in 0.454s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6545a44f-6c68-40b3-b347-df5e8a2cc163 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.45129d7f-a076-4f70-a15b-97af03026ad1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:31 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8039734e-0d83-415a-83b6-c080f920bcdd tempest-VolumeImageDependencyTests-2059485052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-c3d500f4-4a59-4ae0-9bab-e9573e75b159" returned: 0 in 0.314s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:31 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.45129d7f-a076-4f70-a15b-97af03026ad1 Sep 07 14:04:31 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:31 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8039734e-0d83-415a-83b6-c080f920bcdd tempest-VolumeImageDependencyTests-2059485052 None] Lock "cinder-quobyte-c3d500f4-4a59-4ae0-9bab-e9573e75b159" released by "delete_volume" :: held 0.783s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:31 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-8039734e-0d83-415a-83b6-c080f920bcdd tempest-VolumeImageDependencyTests-2059485052 None] Created reservations ['ec2ccba3-ea7d-40de-a6fa-667ada696daf', 'ac5f59d0-8602-4170-9801-5ca16793db73', '73d80e70-2e5b-411e-8a02-499ec962ff18', '92f52265-dbd8-4450-9403-5186b977948f'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8039734e-0d83-415a-83b6-c080f920bcdd tempest-VolumeImageDependencyTests-2059485052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8039734e-0d83-415a-83b6-c080f920bcdd tempest-VolumeImageDependencyTests-2059485052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8039734e-0d83-415a-83b6-c080f920bcdd tempest-VolumeImageDependencyTests-2059485052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8039734e-0d83-415a-83b6-c080f920bcdd tempest-VolumeImageDependencyTests-2059485052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8039734e-0d83-415a-83b6-c080f920bcdd tempest-VolumeImageDependencyTests-2059485052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8039734e-0d83-415a-83b6-c080f920bcdd tempest-VolumeImageDependencyTests-2059485052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:31 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:31 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:31 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6545a44f-6c68-40b3-b347-df5e8a2cc163 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.45129d7f-a076-4f70-a15b-97af03026ad1" returned: 0 in 0.475s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6545a44f-6c68-40b3-b347-df5e8a2cc163 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.45129d7f-a076-4f70-a15b-97af03026ad1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:31 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.45129d7f-a076-4f70-a15b-97af03026ad1 Sep 07 14:04:31 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-33fefbaf-0ef1-4838-b8bf-bb5279e3ed5c tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-33fefbaf-0ef1-4838-b8bf-bb5279e3ed5c tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-33fefbaf-0ef1-4838-b8bf-bb5279e3ed5c tempest-ProjectMemberTests-1858363890 None] Creating offline snapshot f44b4cfa-8b6d-4a7a-8733-2e83f745ee12 of volume 46c4a357-3436-47aa-9d17-aba85bdaf577 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:04:31 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c5e931-8d71-4b02-8d72-16dd313d2e5c]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33fefbaf-0ef1-4838-b8bf-bb5279e3ed5c tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:31 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8039734e-0d83-415a-83b6-c080f920bcdd tempest-VolumeImageDependencyTests-2059485052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.346s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:31 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-8039734e-0d83-415a-83b6-c080f920bcdd tempest-VolumeImageDependencyTests-2059485052 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:31 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-8039734e-0d83-415a-83b6-c080f920bcdd tempest-VolumeImageDependencyTests-2059485052 None] Deleted volume successfully. Sep 07 14:04:31 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8039734e-0d83-415a-83b6-c080f920bcdd tempest-VolumeImageDependencyTests-2059485052 None] Lock "cinder-c3d500f4-4a59-4ae0-9bab-e9573e75b159-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:31 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577 Sep 07 14:04:31 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:32 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6545a44f-6c68-40b3-b347-df5e8a2cc163 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35.45129d7f-a076-4f70-a15b-97af03026ad1" returned: 0 in 0.532s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6545a44f-6c68-40b3-b347-df5e8a2cc163 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-quobyte-45129d7f-a076-4f70-a15b-97af03026ad1" released by "_delete_snapshot" :: held 2.134s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6545a44f-6c68-40b3-b347-df5e8a2cc163 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-quobyte-50c2cd4b-50d3-47d4-8833-9df3e829bd35" released by "delete_snapshot" :: held 2.161s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:32 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33fefbaf-0ef1-4838-b8bf-bb5279e3ed5c tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577" returned: 0 in 0.434s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33fefbaf-0ef1-4838-b8bf-bb5279e3ed5c tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.f44b4cfa-8b6d-4a7a-8733-2e83f745ee12 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:32 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.f44b4cfa-8b6d-4a7a-8733-2e83f745ee12 1G Sep 07 14:04:32 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:32 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-6545a44f-6c68-40b3-b347-df5e8a2cc163 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Created reservations ['7c662cb1-07e0-4ce7-8711-41ee33242afa', '82951499-5d74-460e-aacd-5b31cffd2936', '75d2b038-f954-4114-8bff-f7252e54b88f', '21690bc5-57b5-47c4-8fad-b181e2af46e3'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:32 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-6545a44f-6c68-40b3-b347-df5e8a2cc163 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Delete snapshot completed successfully. Sep 07 14:04:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6545a44f-6c68-40b3-b347-df5e8a2cc163 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-45129d7f-a076-4f70-a15b-97af03026ad1-delete_snapshot" released by "delete_snapshot" :: held 2.426s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:32 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33fefbaf-0ef1-4838-b8bf-bb5279e3ed5c tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.f44b4cfa-8b6d-4a7a-8733-2e83f745ee12 1G" returned: 0 in 0.501s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33fefbaf-0ef1-4838-b8bf-bb5279e3ed5c tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46c4a357-3436-47aa-9d17-aba85bdaf577 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.f44b4cfa-8b6d-4a7a-8733-2e83f745ee12 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:32 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46c4a357-3436-47aa-9d17-aba85bdaf577 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.f44b4cfa-8b6d-4a7a-8733-2e83f745ee12 Sep 07 14:04:32 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:32 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33fefbaf-0ef1-4838-b8bf-bb5279e3ed5c tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46c4a357-3436-47aa-9d17-aba85bdaf577 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.f44b4cfa-8b6d-4a7a-8733-2e83f745ee12" returned: 0 in 0.348s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:32 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-33fefbaf-0ef1-4838-b8bf-bb5279e3ed5c tempest-ProjectMemberTests-1858363890 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.f44b4cfa-8b6d-4a7a-8733-2e83f745ee12 is being set with open permissions: ugo+rw Sep 07 14:04:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33fefbaf-0ef1-4838-b8bf-bb5279e3ed5c tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.f44b4cfa-8b6d-4a7a-8733-2e83f745ee12 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:33 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.f44b4cfa-8b6d-4a7a-8733-2e83f745ee12 Sep 07 14:04:33 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-611bbe2b-9932-4513-a86c-68241f3aa2d2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "cinder-50c2cd4b-50d3-47d4-8833-9df3e829bd35-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-611bbe2b-9932-4513-a86c-68241f3aa2d2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-50c2cd4b-50d3-47d4-8833-9df3e829bd35-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-611bbe2b-9932-4513-a86c-68241f3aa2d2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "cinder-quobyte-50c2cd4b-50d3-47d4-8833-9df3e829bd35" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-611bbe2b-9932-4513-a86c-68241f3aa2d2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-quobyte-50c2cd4b-50d3-47d4-8833-9df3e829bd35" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:33 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bec8a35-5d2c-4c38-8eb0-42dca7058cd4]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-611bbe2b-9932-4513-a86c-68241f3aa2d2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:33 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33fefbaf-0ef1-4838-b8bf-bb5279e3ed5c tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.f44b4cfa-8b6d-4a7a-8733-2e83f745ee12" returned: 0 in 0.378s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33fefbaf-0ef1-4838-b8bf-bb5279e3ed5c tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:33 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35 Sep 07 14:04:33 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:33 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.info Sep 07 14:04:33 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:33 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:33 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-611bbe2b-9932-4513-a86c-68241f3aa2d2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35" returned: 0 in 0.432s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-611bbe2b-9932-4513-a86c-68241f3aa2d2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33fefbaf-0ef1-4838-b8bf-bb5279e3ed5c tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.info" returned: 0 in 0.332s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:33 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-33fefbaf-0ef1-4838-b8bf-bb5279e3ed5c tempest-ProjectMemberTests-1858363890 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.info is being set with open permissions: ugo+rw Sep 07 14:04:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33fefbaf-0ef1-4838-b8bf-bb5279e3ed5c tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:33 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35 Sep 07 14:04:33 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:33 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.info Sep 07 14:04:33 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:34 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-611bbe2b-9932-4513-a86c-68241f3aa2d2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-50c2cd4b-50d3-47d4-8833-9df3e829bd35" returned: 0 in 0.274s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:34 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-33fefbaf-0ef1-4838-b8bf-bb5279e3ed5c tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.info" returned: 0 in 0.277s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-33fefbaf-0ef1-4838-b8bf-bb5279e3ed5c tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.409s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-611bbe2b-9932-4513-a86c-68241f3aa2d2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-quobyte-50c2cd4b-50d3-47d4-8833-9df3e829bd35" released by "delete_volume" :: held 0.816s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:34 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-33fefbaf-0ef1-4838-b8bf-bb5279e3ed5c tempest-ProjectMemberTests-1858363890 None] Create snapshot completed successfully Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-611bbe2b-9932-4513-a86c-68241f3aa2d2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Created reservations ['3764715c-df27-4f9e-a448-58e7aded4fc9', '348a9407-7c5e-480e-a63c-c8027a12adb3', 'a320e394-b3f4-4c2f-ab76-9bd6a7e21918', 'e5b7216a-f852-477d-a5a7-26dcaab5e4bd'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-611bbe2b-9932-4513-a86c-68241f3aa2d2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-611bbe2b-9932-4513-a86c-68241f3aa2d2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-611bbe2b-9932-4513-a86c-68241f3aa2d2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-611bbe2b-9932-4513-a86c-68241f3aa2d2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-611bbe2b-9932-4513-a86c-68241f3aa2d2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-611bbe2b-9932-4513-a86c-68241f3aa2d2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:34 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:34 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:34 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-611bbe2b-9932-4513-a86c-68241f3aa2d2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.310s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-611bbe2b-9932-4513-a86c-68241f3aa2d2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:34 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-611bbe2b-9932-4513-a86c-68241f3aa2d2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Deleted volume successfully. Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-611bbe2b-9932-4513-a86c-68241f3aa2d2 tempest-CreateVolumesFromSnapshotTest-1302931607 None] Lock "cinder-50c2cd4b-50d3-47d4-8833-9df3e829bd35-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2cd2e715-175d-4fd7-80f3-5f694fe9b6bc tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-f44b4cfa-8b6d-4a7a-8733-2e83f745ee12-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2cd2e715-175d-4fd7-80f3-5f694fe9b6bc tempest-ProjectMemberTests-1858363890 None] Lock "cinder-f44b4cfa-8b6d-4a7a-8733-2e83f745ee12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2cd2e715-175d-4fd7-80f3-5f694fe9b6bc tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-46c4a357-3436-47aa-9d17-aba85bdaf577" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2cd2e715-175d-4fd7-80f3-5f694fe9b6bc tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-46c4a357-3436-47aa-9d17-aba85bdaf577" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2cd2e715-175d-4fd7-80f3-5f694fe9b6bc tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-f44b4cfa-8b6d-4a7a-8733-2e83f745ee12" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2cd2e715-175d-4fd7-80f3-5f694fe9b6bc tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-f44b4cfa-8b6d-4a7a-8733-2e83f745ee12" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-2cd2e715-175d-4fd7-80f3-5f694fe9b6bc tempest-ProjectMemberTests-1858363890 None] Deleting offline snapshot f44b4cfa-8b6d-4a7a-8733-2e83f745ee12 of volume 46c4a357-3436-47aa-9d17-aba85bdaf577 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-2cd2e715-175d-4fd7-80f3-5f694fe9b6bc tempest-ProjectMemberTests-1858363890 None] snapshot_file for this snap is: volume-46c4a357-3436-47aa-9d17-aba85bdaf577.f44b4cfa-8b6d-4a7a-8733-2e83f745ee12 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d0ceb2-e3dd-44af-a699-38650a878ac1]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2cd2e715-175d-4fd7-80f3-5f694fe9b6bc tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.f44b4cfa-8b6d-4a7a-8733-2e83f745ee12 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Flow 'volume_create_manager' (59861926-8d2e-4759-a80c-2e877239b99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef567293-1dd8-4788-a99a-d67da351acdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef567293-1dd8-4788-a99a-d67da351acdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760843287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc4f618-07df-45c6-8c50-11b95985ea63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f88686a757b48d2ac1a60b2911cabe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:35Z,use_quota=True,user_id='28a72580cb7e409aa7c0843102d083c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62e838f-64b0-40e1-9956-80d20e939154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:35 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.f44b4cfa-8b6d-4a7a-8733-2e83f745ee12 Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62e838f-64b0-40e1-9956-80d20e939154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:35 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1119ddeb-7eb5-41ab-9599-d3382bc4cf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1119ddeb-7eb5-41ab-9599-d3382bc4cf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cc4f618-07df-45c6-8c50-11b95985ea63', 'volume_name': 'volume-8cc4f618-07df-45c6-8c50-11b95985ea63', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26771d6-405a-436e-b4db-86195c2cc801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26771d6-405a-436e-b4db-86195c2cc801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc328bd-aa96-4471-995b-a172147ff443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:35 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Volume 8cc4f618-07df-45c6-8c50-11b95985ea63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cc4f618-07df-45c6-8c50-11b95985ea63', 'volume_size': 1} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760843287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc4f618-07df-45c6-8c50-11b95985ea63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f88686a757b48d2ac1a60b2911cabe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:35Z,use_quota=True,user_id='28a72580cb7e409aa7c0843102d083c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Creating volume 8cc4f618-07df-45c6-8c50-11b95985ea63 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:35 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:35 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63 1073741824 Sep 07 14:04:35 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:35 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2cd2e715-175d-4fd7-80f3-5f694fe9b6bc tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.f44b4cfa-8b6d-4a7a-8733-2e83f745ee12" returned: 0 in 0.466s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-2cd2e715-175d-4fd7-80f3-5f694fe9b6bc tempest-ProjectMemberTests-1858363890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46c4a357-3436-47aa-9d17-aba85bdaf577(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb91dc1-c368-48f7-a307-8b794c366e59]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2cd2e715-175d-4fd7-80f3-5f694fe9b6bc tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:35 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577 Sep 07 14:04:35 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:35 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63 1073741824" returned: 0 in 0.556s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:35 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63 Sep 07 14:04:35 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:35 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2cd2e715-175d-4fd7-80f3-5f694fe9b6bc tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577" returned: 0 in 0.482s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2cd2e715-175d-4fd7-80f3-5f694fe9b6bc tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.f44b4cfa-8b6d-4a7a-8733-2e83f745ee12 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:35 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.f44b4cfa-8b6d-4a7a-8733-2e83f745ee12 Sep 07 14:04:35 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:36 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63" returned: 0 in 0.359s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc328bd-aa96-4471-995b-a172147ff443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cc4f618-07df-45c6-8c50-11b95985ea63', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdcfbf8b-e7fe-43da-906e-e6fcdf29f057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:36 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Volume volume-8cc4f618-07df-45c6-8c50-11b95985ea63 (8cc4f618-07df-45c6-8c50-11b95985ea63): created successfully Sep 07 14:04:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdcfbf8b-e7fe-43da-906e-e6fcdf29f057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:36 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Flow 'volume_create_manager' (59861926-8d2e-4759-a80c-2e877239b99f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:36 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-5e565ab6-497e-4661-ad2b-0f57091ad022 tempest-ProjectReaderTests-2123950541 None] Created volume successfully. Sep 07 14:04:36 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2cd2e715-175d-4fd7-80f3-5f694fe9b6bc tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.f44b4cfa-8b6d-4a7a-8733-2e83f745ee12" returned: 0 in 0.416s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2cd2e715-175d-4fd7-80f3-5f694fe9b6bc tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.f44b4cfa-8b6d-4a7a-8733-2e83f745ee12 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:36 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.f44b4cfa-8b6d-4a7a-8733-2e83f745ee12 Sep 07 14:04:36 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:36 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2cd2e715-175d-4fd7-80f3-5f694fe9b6bc tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577.f44b4cfa-8b6d-4a7a-8733-2e83f745ee12" returned: 0 in 0.251s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:36 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2cd2e715-175d-4fd7-80f3-5f694fe9b6bc tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-f44b4cfa-8b6d-4a7a-8733-2e83f745ee12" released by "_delete_snapshot" :: held 1.747s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:36 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2cd2e715-175d-4fd7-80f3-5f694fe9b6bc tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-46c4a357-3436-47aa-9d17-aba85bdaf577" released by "delete_snapshot" :: held 1.782s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:36 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-2cd2e715-175d-4fd7-80f3-5f694fe9b6bc tempest-ProjectMemberTests-1858363890 None] Created reservations ['423cb5d7-4b71-41dc-a4f9-ddca45f8f3b3', '81d3bc85-505c-4add-8627-f35adbb6309b', '4dffc653-81a1-4c8d-9027-9f19193235b7', '6c5673aa-82b4-4e6e-87fa-3fe2d63921f7'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:36 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-2cd2e715-175d-4fd7-80f3-5f694fe9b6bc tempest-ProjectMemberTests-1858363890 None] Delete snapshot completed successfully. Sep 07 14:04:36 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2cd2e715-175d-4fd7-80f3-5f694fe9b6bc tempest-ProjectMemberTests-1858363890 None] Lock "cinder-f44b4cfa-8b6d-4a7a-8733-2e83f745ee12-delete_snapshot" released by "delete_snapshot" :: held 1.949s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:37 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6cfcc382-b270-4a38-aa42-b0e183f834f5 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-46c4a357-3436-47aa-9d17-aba85bdaf577-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:37 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6cfcc382-b270-4a38-aa42-b0e183f834f5 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-46c4a357-3436-47aa-9d17-aba85bdaf577-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:37 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6cfcc382-b270-4a38-aa42-b0e183f834f5 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-46c4a357-3436-47aa-9d17-aba85bdaf577" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:37 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6cfcc382-b270-4a38-aa42-b0e183f834f5 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-46c4a357-3436-47aa-9d17-aba85bdaf577" acquired by "delete_volume" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:37 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf5516d-7738-44da-beaa-101f234d02fc]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6cfcc382-b270-4a38-aa42-b0e183f834f5 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:37 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577 Sep 07 14:04:37 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e490ec67-ded4-4c13-a007-5eb5e32b67ac tempest-ProjectReaderTests-2123950541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e490ec67-ded4-4c13-a007-5eb5e32b67ac tempest-ProjectReaderTests-2123950541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:37 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-e490ec67-ded4-4c13-a007-5eb5e32b67ac tempest-ProjectReaderTests-2123950541 None] Creating offline snapshot 52561bac-7810-4edc-902c-017846f5c31d of volume 8cc4f618-07df-45c6-8c50-11b95985ea63 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:04:37 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37fabff-cb84-4e26-9a3d-229107d112fd]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e490ec67-ded4-4c13-a007-5eb5e32b67ac tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:37 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63 Sep 07 14:04:37 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:37 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6cfcc382-b270-4a38-aa42-b0e183f834f5 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577" returned: 0 in 0.490s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6cfcc382-b270-4a38-aa42-b0e183f834f5 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:37 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577 Sep 07 14:04:37 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:38 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e490ec67-ded4-4c13-a007-5eb5e32b67ac tempest-ProjectReaderTests-2123950541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63" returned: 0 in 0.502s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:38 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e490ec67-ded4-4c13-a007-5eb5e32b67ac tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.52561bac-7810-4edc-902c-017846f5c31d 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6cfcc382-b270-4a38-aa42-b0e183f834f5 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-46c4a357-3436-47aa-9d17-aba85bdaf577" returned: 0 in 0.337s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:38 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.52561bac-7810-4edc-902c-017846f5c31d 1G Sep 07 14:04:38 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6cfcc382-b270-4a38-aa42-b0e183f834f5 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-46c4a357-3436-47aa-9d17-aba85bdaf577" released by "delete_volume" :: held 0.923s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-6cfcc382-b270-4a38-aa42-b0e183f834f5 tempest-ProjectMemberTests-1858363890 None] Created reservations ['7d8a2d8d-802f-45e4-bf64-164393523e85', '8bf4ffea-0b4f-4fce-a488-029b8b1d1ae5', 'd2d83257-0cd9-44ed-8a85-8653bf8d84b7', '8ba504d7-444f-4887-ba71-b7e3436d1b01'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Flow 'volume_create_manager' (118c0ee8-ef35-4540-a1a8-fadacf624d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85386d3-55d7-447c-a542-45eae1391443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85386d3-55d7-447c-a542-45eae1391443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-669255408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=133e3509-862e-48a6-94cc-6b47084717fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70cdd4dbcadd46409e6bd5a1b28d635b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:38Z,use_quota=True,user_id='e9f2a2d2d37841afbf9d9d10c403960f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba534bf-0f83-431a-99de-48dedc4d1e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba534bf-0f83-431a-99de-48dedc4d1e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a9261e9-5428-4b0f-bc14-99fc34c5e424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a9261e9-5428-4b0f-bc14-99fc34c5e424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '133e3509-862e-48a6-94cc-6b47084717fc', 'volume_name': 'volume-133e3509-862e-48a6-94cc-6b47084717fc', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4d78d3-3605-4e78-a675-08cd886a7605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4d78d3-3605-4e78-a675-08cd886a7605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23485e6e-f6be-410c-9f4f-a2c0d665648d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:38 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Volume 133e3509-862e-48a6-94cc-6b47084717fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-133e3509-862e-48a6-94cc-6b47084717fc', 'volume_size': 1} Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6cfcc382-b270-4a38-aa42-b0e183f834f5 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6cfcc382-b270-4a38-aa42-b0e183f834f5 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-6cfcc382-b270-4a38-aa42-b0e183f834f5 tempest-ProjectMemberTests-1858363890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-6cfcc382-b270-4a38-aa42-b0e183f834f5 tempest-ProjectMemberTests-1858363890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6cfcc382-b270-4a38-aa42-b0e183f834f5 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6cfcc382-b270-4a38-aa42-b0e183f834f5 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:38 devstack sudo[107916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:38 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:38 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e490ec67-ded4-4c13-a007-5eb5e32b67ac tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.52561bac-7810-4edc-902c-017846f5c31d 1G" returned: 0 in 0.514s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e490ec67-ded4-4c13-a007-5eb5e32b67ac tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cc4f618-07df-45c6-8c50-11b95985ea63 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.52561bac-7810-4edc-902c-017846f5c31d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:38 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cc4f618-07df-45c6-8c50-11b95985ea63 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.52561bac-7810-4edc-902c-017846f5c31d Sep 07 14:04:38 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:38 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6cfcc382-b270-4a38-aa42-b0e183f834f5 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.280s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-6cfcc382-b270-4a38-aa42-b0e183f834f5 tempest-ProjectMemberTests-1858363890 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:38 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-6cfcc382-b270-4a38-aa42-b0e183f834f5 tempest-ProjectMemberTests-1858363890 None] Deleted volume successfully. Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6cfcc382-b270-4a38-aa42-b0e183f834f5 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-46c4a357-3436-47aa-9d17-aba85bdaf577-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:38 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e490ec67-ded4-4c13-a007-5eb5e32b67ac tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cc4f618-07df-45c6-8c50-11b95985ea63 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.52561bac-7810-4edc-902c-017846f5c31d" returned: 0 in 0.306s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:38 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-e490ec67-ded4-4c13-a007-5eb5e32b67ac tempest-ProjectReaderTests-2123950541 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.52561bac-7810-4edc-902c-017846f5c31d is being set with open permissions: ugo+rw Sep 07 14:04:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e490ec67-ded4-4c13-a007-5eb5e32b67ac tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.52561bac-7810-4edc-902c-017846f5c31d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:38 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.52561bac-7810-4edc-902c-017846f5c31d Sep 07 14:04:38 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:39 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e490ec67-ded4-4c13-a007-5eb5e32b67ac tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.52561bac-7810-4edc-902c-017846f5c31d" returned: 0 in 0.248s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e490ec67-ded4-4c13-a007-5eb5e32b67ac tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:39 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.info Sep 07 14:04:39 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:39 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e490ec67-ded4-4c13-a007-5eb5e32b67ac tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.info" returned: 0 in 0.270s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:39 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-e490ec67-ded4-4c13-a007-5eb5e32b67ac tempest-ProjectReaderTests-2123950541 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.info is being set with open permissions: ugo+rw Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e490ec67-ded4-4c13-a007-5eb5e32b67ac tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:39 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.info Sep 07 14:04:39 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:39 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e490ec67-ded4-4c13-a007-5eb5e32b67ac tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.info" returned: 0 in 0.276s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e490ec67-ded4-4c13-a007-5eb5e32b67ac tempest-ProjectReaderTests-2123950541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.227s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.392s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-669255408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=133e3509-862e-48a6-94cc-6b47084717fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70cdd4dbcadd46409e6bd5a1b28d635b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:38Z,use_quota=True,user_id='e9f2a2d2d37841afbf9d9d10c403960f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Creating volume 133e3509-862e-48a6-94cc-6b47084717fc {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:39 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:39 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc 1073741824 Sep 07 14:04:39 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:39 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-e490ec67-ded4-4c13-a007-5eb5e32b67ac tempest-ProjectReaderTests-2123950541 None] Create snapshot completed successfully Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Flow 'volume_create_manager' (18e6c012-7c28-4a0e-802e-5b50eb0f8003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ea95ca-a7e3-412a-afd2-cd9981e1e39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ea95ca-a7e3-412a-afd2-cd9981e1e39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1998389320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ce8c9d-60b1-4563-8b47-5cc5032425cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8fd9674bb249b899d5c69373880941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:40Z,use_quota=True,user_id='30c462f1a0094053b9f39392ba6e3442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34a295f9-cc1a-4810-8c0c-d2326cf4a2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34a295f9-cc1a-4810-8c0c-d2326cf4a2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ae7a9b-2c8b-43db-8841-3930bceddbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ae7a9b-2c8b-43db-8841-3930bceddbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5ce8c9d-60b1-4563-8b47-5cc5032425cd', 'volume_name': 'volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eeb4572-4c73-4201-8d5b-b17bd08c07d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eeb4572-4c73-4201-8d5b-b17bd08c07d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e056c1-cfe2-4e75-bdf6-0545cc384069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:39 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Volume d5ce8c9d-60b1-4563-8b47-5cc5032425cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd', 'volume_size': 1} Sep 07 14:04:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:40 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc 1073741824" returned: 0 in 0.478s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:40 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc Sep 07 14:04:40 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:40 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc" returned: 0 in 0.238s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.559s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1998389320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ce8c9d-60b1-4563-8b47-5cc5032425cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8fd9674bb249b899d5c69373880941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:40Z,use_quota=True,user_id='30c462f1a0094053b9f39392ba6e3442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Creating volume d5ce8c9d-60b1-4563-8b47-5cc5032425cd {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:40 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:40 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd 1073741824 Sep 07 14:04:40 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23485e6e-f6be-410c-9f4f-a2c0d665648d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-133e3509-862e-48a6-94cc-6b47084717fc', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d643e4d-8ca0-47e7-aff1-e16c84c0cda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:40 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Volume volume-133e3509-862e-48a6-94cc-6b47084717fc (133e3509-862e-48a6-94cc-6b47084717fc): created successfully Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d643e4d-8ca0-47e7-aff1-e16c84c0cda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Flow 'volume_create_manager' (118c0ee8-ef35-4540-a1a8-fadacf624d79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:40 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c845eaca-bf3e-4443-becc-7b9a65f05335 tempest-VolumeDependencyTests-1010503134 None] Created volume successfully. Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2da245e8-544b-4eba-b5f1-1dfd1f0ebd6f tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-52561bac-7810-4edc-902c-017846f5c31d-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2da245e8-544b-4eba-b5f1-1dfd1f0ebd6f tempest-ProjectReaderTests-2123950541 None] Lock "cinder-52561bac-7810-4edc-902c-017846f5c31d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2da245e8-544b-4eba-b5f1-1dfd1f0ebd6f tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-quobyte-8cc4f618-07df-45c6-8c50-11b95985ea63" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2da245e8-544b-4eba-b5f1-1dfd1f0ebd6f tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-8cc4f618-07df-45c6-8c50-11b95985ea63" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2da245e8-544b-4eba-b5f1-1dfd1f0ebd6f tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-quobyte-52561bac-7810-4edc-902c-017846f5c31d" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2da245e8-544b-4eba-b5f1-1dfd1f0ebd6f tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-52561bac-7810-4edc-902c-017846f5c31d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-2da245e8-544b-4eba-b5f1-1dfd1f0ebd6f tempest-ProjectReaderTests-2123950541 None] Deleting offline snapshot 52561bac-7810-4edc-902c-017846f5c31d of volume 8cc4f618-07df-45c6-8c50-11b95985ea63 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-2da245e8-544b-4eba-b5f1-1dfd1f0ebd6f tempest-ProjectReaderTests-2123950541 None] snapshot_file for this snap is: volume-8cc4f618-07df-45c6-8c50-11b95985ea63.52561bac-7810-4edc-902c-017846f5c31d {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec9ea44-4345-4323-810e-aa60222d092c]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2da245e8-544b-4eba-b5f1-1dfd1f0ebd6f tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.52561bac-7810-4edc-902c-017846f5c31d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:41 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd 1073741824" returned: 0 in 0.521s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:41 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd Sep 07 14:04:41 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:41 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.52561bac-7810-4edc-902c-017846f5c31d Sep 07 14:04:41 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Flow 'volume_create_manager' (d3f1cc87-d013-4c99-a2af-bd9e2dbc7528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6254b8-b1f7-4894-bbc4-dc7c765e727e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6254b8-b1f7-4894-bbc4-dc7c765e727e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-200446684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8edffd33-ab08-454c-b5d2-4ef0c9830d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd80b19127894f05b2b6f5083736d0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:41Z,use_quota=True,user_id='36f25a4a1cef480d9fbafc336f2af6b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d4ab54-57e1-401c-91e4-4b0c84114892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d4ab54-57e1-401c-91e4-4b0c84114892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c885e96-3142-4dc7-b67c-2d861e591a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c885e96-3142-4dc7-b67c-2d861e591a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8edffd33-ab08-454c-b5d2-4ef0c9830d9d', 'volume_name': 'volume-8edffd33-ab08-454c-b5d2-4ef0c9830d9d', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e12da14-2c1d-41b3-98de-e9507fa92b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:41 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e12da14-2c1d-41b3-98de-e9507fa92b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3597c6e2-6ef9-49d7-b872-6f60aced92c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:41 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Volume 8edffd33-ab08-454c-b5d2-4ef0c9830d9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8edffd33-ab08-454c-b5d2-4ef0c9830d9d', 'volume_size': 1} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd" returned: 0 in 0.352s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-200446684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8edffd33-ab08-454c-b5d2-4ef0c9830d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd80b19127894f05b2b6f5083736d0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:41Z,use_quota=True,user_id='36f25a4a1cef480d9fbafc336f2af6b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Creating volume 8edffd33-ab08-454c-b5d2-4ef0c9830d9d {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:41 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8edffd33-ab08-454c-b5d2-4ef0c9830d9d 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:41 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2da245e8-544b-4eba-b5f1-1dfd1f0ebd6f tempest-ProjectReaderTests-2123950541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.52561bac-7810-4edc-902c-017846f5c31d" returned: 0 in 0.449s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-2da245e8-544b-4eba-b5f1-1dfd1f0ebd6f tempest-ProjectReaderTests-2123950541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cc4f618-07df-45c6-8c50-11b95985ea63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:04:41 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8edffd33-ab08-454c-b5d2-4ef0c9830d9d 1073741824 Sep 07 14:04:41 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e056c1-cfe2-4e75-bdf6-0545cc384069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b85bb7-5280-4935-8442-a7bab2c897ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb4dfca-c2ef-4c1a-9a13-3ddc02448a21]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2da245e8-544b-4eba-b5f1-1dfd1f0ebd6f tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:41 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Volume volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd (d5ce8c9d-60b1-4563-8b47-5cc5032425cd): created successfully Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b85bb7-5280-4935-8442-a7bab2c897ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Flow 'volume_create_manager' (18e6c012-7c28-4a0e-802e-5b50eb0f8003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-37c32bf0-fd8a-4cbe-a707-79de7db61e4b tempest-VolumeDependencyTests-1010503134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:41 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-d9c1c713-aaf2-4d56-898c-f11a8476137e tempest-ProjectMemberTests-1858363890 None] Created volume successfully. Sep 07 14:04:41 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63 Sep 07 14:04:41 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:41 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8edffd33-ab08-454c-b5d2-4ef0c9830d9d 1073741824" returned: 0 in 0.422s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:41 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2da245e8-544b-4eba-b5f1-1dfd1f0ebd6f tempest-ProjectReaderTests-2123950541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63" returned: 0 in 0.390s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2da245e8-544b-4eba-b5f1-1dfd1f0ebd6f tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.52561bac-7810-4edc-902c-017846f5c31d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8edffd33-ab08-454c-b5d2-4ef0c9830d9d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:41 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.52561bac-7810-4edc-902c-017846f5c31d Sep 07 14:04:41 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:41 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8edffd33-ab08-454c-b5d2-4ef0c9830d9d Sep 07 14:04:41 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7ea91dba-c508-4cc5-9983-646a4275d52d tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:42 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8edffd33-ab08-454c-b5d2-4ef0c9830d9d" returned: 0 in 0.273s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-37c32bf0-fd8a-4cbe-a707-79de7db61e4b tempest-VolumeDependencyTests-1010503134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.631s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3597c6e2-6ef9-49d7-b872-6f60aced92c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8edffd33-ab08-454c-b5d2-4ef0c9830d9d', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f27d1e-114a-4177-b728-c1e76a38526d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-37c32bf0-fd8a-4cbe-a707-79de7db61e4b tempest-VolumeDependencyTests-1010503134 None] Creating offline snapshot 500150e2-3c27-4dc9-84c6-95fdd290c02c of volume 133e3509-862e-48a6-94cc-6b47084717fc {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:04:42 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Volume volume-8edffd33-ab08-454c-b5d2-4ef0c9830d9d (8edffd33-ab08-454c-b5d2-4ef0c9830d9d): created successfully Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f27d1e-114a-4177-b728-c1e76a38526d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Flow 'volume_create_manager' (d3f1cc87-d013-4c99-a2af-bd9e2dbc7528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[05688fee-fc3b-4278-a922-9acd8e0afbcf]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-37c32bf0-fd8a-4cbe-a707-79de7db61e4b tempest-VolumeDependencyTests-1010503134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:42 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2da245e8-544b-4eba-b5f1-1dfd1f0ebd6f tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.52561bac-7810-4edc-902c-017846f5c31d" returned: 0 in 0.370s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2da245e8-544b-4eba-b5f1-1dfd1f0ebd6f tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.52561bac-7810-4edc-902c-017846f5c31d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:42 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-2d380523-c95d-453f-bb6c-69373387fe08 tempest-ProjectReaderTests-841007551 None] Created volume successfully. Sep 07 14:04:42 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.52561bac-7810-4edc-902c-017846f5c31d Sep 07 14:04:42 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:42 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc Sep 07 14:04:42 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-598c8ca0-2670-49fa-8c96-828900f68143 tempest-ProjectReaderTests-841007551 None] Acquiring lock "cinder-8edffd33-ab08-454c-b5d2-4ef0c9830d9d-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-598c8ca0-2670-49fa-8c96-828900f68143 tempest-ProjectReaderTests-841007551 None] Lock "cinder-8edffd33-ab08-454c-b5d2-4ef0c9830d9d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:42 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2da245e8-544b-4eba-b5f1-1dfd1f0ebd6f tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63.52561bac-7810-4edc-902c-017846f5c31d" returned: 0 in 0.272s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2da245e8-544b-4eba-b5f1-1dfd1f0ebd6f tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-52561bac-7810-4edc-902c-017846f5c31d" released by "_delete_snapshot" :: held 1.620s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2da245e8-544b-4eba-b5f1-1dfd1f0ebd6f tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-8cc4f618-07df-45c6-8c50-11b95985ea63" released by "delete_snapshot" :: held 1.649s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-598c8ca0-2670-49fa-8c96-828900f68143 tempest-ProjectReaderTests-841007551 None] Acquiring lock "cinder-quobyte-8edffd33-ab08-454c-b5d2-4ef0c9830d9d" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-598c8ca0-2670-49fa-8c96-828900f68143 tempest-ProjectReaderTests-841007551 None] Lock "cinder-quobyte-8edffd33-ab08-454c-b5d2-4ef0c9830d9d" acquired by "delete_volume" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:42 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-37c32bf0-fd8a-4cbe-a707-79de7db61e4b tempest-VolumeDependencyTests-1010503134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc" returned: 0 in 0.397s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-37c32bf0-fd8a-4cbe-a707-79de7db61e4b tempest-VolumeDependencyTests-1010503134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.500150e2-3c27-4dc9-84c6-95fdd290c02c 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6df4b3-81f2-48e4-9ad1-4cd18a9b9eeb]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-598c8ca0-2670-49fa-8c96-828900f68143 tempest-ProjectReaderTests-841007551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8edffd33-ab08-454c-b5d2-4ef0c9830d9d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:42 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.500150e2-3c27-4dc9-84c6-95fdd290c02c 1G Sep 07 14:04:42 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-2da245e8-544b-4eba-b5f1-1dfd1f0ebd6f tempest-ProjectReaderTests-2123950541 None] Created reservations ['766e4794-545a-4e0f-8cc9-b36b0365c5d1', 'b58e2148-8ae7-4e9d-ab62-09b382ec506d', '8ca5820c-a25f-463d-abbe-5f82282de2db', '3f171f2a-3d09-43d6-9a34-57ed98ca2626'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:42 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-2da245e8-544b-4eba-b5f1-1dfd1f0ebd6f tempest-ProjectReaderTests-2123950541 None] Delete snapshot completed successfully. Sep 07 14:04:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2da245e8-544b-4eba-b5f1-1dfd1f0ebd6f tempest-ProjectReaderTests-2123950541 None] Lock "cinder-52561bac-7810-4edc-902c-017846f5c31d-delete_snapshot" released by "delete_snapshot" :: held 1.839s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:42 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8edffd33-ab08-454c-b5d2-4ef0c9830d9d Sep 07 14:04:42 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:43 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-598c8ca0-2670-49fa-8c96-828900f68143 tempest-ProjectReaderTests-841007551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8edffd33-ab08-454c-b5d2-4ef0c9830d9d" returned: 0 in 0.375s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-598c8ca0-2670-49fa-8c96-828900f68143 tempest-ProjectReaderTests-841007551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8edffd33-ab08-454c-b5d2-4ef0c9830d9d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:43 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-37c32bf0-fd8a-4cbe-a707-79de7db61e4b tempest-VolumeDependencyTests-1010503134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.500150e2-3c27-4dc9-84c6-95fdd290c02c 1G" returned: 0 in 0.401s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-37c32bf0-fd8a-4cbe-a707-79de7db61e4b tempest-VolumeDependencyTests-1010503134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-133e3509-862e-48a6-94cc-6b47084717fc -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.500150e2-3c27-4dc9-84c6-95fdd290c02c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:43 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8edffd33-ab08-454c-b5d2-4ef0c9830d9d Sep 07 14:04:43 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dbbc7228-07b4-429c-93f7-17567b09fa02 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-8cc4f618-07df-45c6-8c50-11b95985ea63-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:43 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-133e3509-862e-48a6-94cc-6b47084717fc -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.500150e2-3c27-4dc9-84c6-95fdd290c02c Sep 07 14:04:43 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dbbc7228-07b4-429c-93f7-17567b09fa02 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-8cc4f618-07df-45c6-8c50-11b95985ea63-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dbbc7228-07b4-429c-93f7-17567b09fa02 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-quobyte-8cc4f618-07df-45c6-8c50-11b95985ea63" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dbbc7228-07b4-429c-93f7-17567b09fa02 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-8cc4f618-07df-45c6-8c50-11b95985ea63" acquired by "delete_volume" :: waited 0.015s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e09096-f9da-404d-b039-896fb19c5155]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dbbc7228-07b4-429c-93f7-17567b09fa02 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:43 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-598c8ca0-2670-49fa-8c96-828900f68143 tempest-ProjectReaderTests-841007551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8edffd33-ab08-454c-b5d2-4ef0c9830d9d" returned: 0 in 0.277s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:43 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63 Sep 07 14:04:43 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-598c8ca0-2670-49fa-8c96-828900f68143 tempest-ProjectReaderTests-841007551 None] Lock "cinder-quobyte-8edffd33-ab08-454c-b5d2-4ef0c9830d9d" released by "delete_volume" :: held 0.697s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-598c8ca0-2670-49fa-8c96-828900f68143 tempest-ProjectReaderTests-841007551 None] Created reservations ['a0610c06-61b4-4c0b-95d5-9b9f981f82f3', '23651e09-166f-4e9d-b69f-93b38eebe15f', 'c97e772b-7a8e-4fe5-bb68-da7775d06867', 'ca2bafd7-2208-408d-9ac3-352133f8792a'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:43 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-37c32bf0-fd8a-4cbe-a707-79de7db61e4b tempest-VolumeDependencyTests-1010503134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-133e3509-862e-48a6-94cc-6b47084717fc -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.500150e2-3c27-4dc9-84c6-95fdd290c02c" returned: 0 in 0.348s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:43 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-37c32bf0-fd8a-4cbe-a707-79de7db61e4b tempest-VolumeDependencyTests-1010503134 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.500150e2-3c27-4dc9-84c6-95fdd290c02c is being set with open permissions: ugo+rw Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-37c32bf0-fd8a-4cbe-a707-79de7db61e4b tempest-VolumeDependencyTests-1010503134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.500150e2-3c27-4dc9-84c6-95fdd290c02c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:43 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.500150e2-3c27-4dc9-84c6-95fdd290c02c Sep 07 14:04:43 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-598c8ca0-2670-49fa-8c96-828900f68143 tempest-ProjectReaderTests-841007551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-598c8ca0-2670-49fa-8c96-828900f68143 tempest-ProjectReaderTests-841007551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-598c8ca0-2670-49fa-8c96-828900f68143 tempest-ProjectReaderTests-841007551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-598c8ca0-2670-49fa-8c96-828900f68143 tempest-ProjectReaderTests-841007551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-598c8ca0-2670-49fa-8c96-828900f68143 tempest-ProjectReaderTests-841007551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-598c8ca0-2670-49fa-8c96-828900f68143 tempest-ProjectReaderTests-841007551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:43 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:43 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:43 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dbbc7228-07b4-429c-93f7-17567b09fa02 tempest-ProjectReaderTests-2123950541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63" returned: 0 in 0.405s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dbbc7228-07b4-429c-93f7-17567b09fa02 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:43 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63 Sep 07 14:04:43 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:43 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-37c32bf0-fd8a-4cbe-a707-79de7db61e4b tempest-VolumeDependencyTests-1010503134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.500150e2-3c27-4dc9-84c6-95fdd290c02c" returned: 0 in 0.283s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-37c32bf0-fd8a-4cbe-a707-79de7db61e4b tempest-VolumeDependencyTests-1010503134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:43 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.info Sep 07 14:04:43 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:43 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-598c8ca0-2670-49fa-8c96-828900f68143 tempest-ProjectReaderTests-841007551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.280s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-598c8ca0-2670-49fa-8c96-828900f68143 tempest-ProjectReaderTests-841007551 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:43 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-598c8ca0-2670-49fa-8c96-828900f68143 tempest-ProjectReaderTests-841007551 None] Deleted volume successfully. Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-598c8ca0-2670-49fa-8c96-828900f68143 tempest-ProjectReaderTests-841007551 None] Lock "cinder-8edffd33-ab08-454c-b5d2-4ef0c9830d9d-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:43 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dbbc7228-07b4-429c-93f7-17567b09fa02 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-8cc4f618-07df-45c6-8c50-11b95985ea63" returned: 0 in 0.296s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dbbc7228-07b4-429c-93f7-17567b09fa02 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-8cc4f618-07df-45c6-8c50-11b95985ea63" released by "delete_volume" :: held 0.767s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-dbbc7228-07b4-429c-93f7-17567b09fa02 tempest-ProjectReaderTests-2123950541 None] Created reservations ['9a725030-73a7-4805-9dd6-598f9f4ae21e', '5c4fc922-c4e5-4bd9-9d1f-5e64a560ab93', '7ba502ba-5c04-49e0-bf2f-6c864a7f56fd', '508d067f-ff96-428a-9c60-c8fe40509f3c'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:43 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-37c32bf0-fd8a-4cbe-a707-79de7db61e4b tempest-VolumeDependencyTests-1010503134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.info" returned: 0 in 0.297s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:43 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-37c32bf0-fd8a-4cbe-a707-79de7db61e4b tempest-VolumeDependencyTests-1010503134 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.info is being set with open permissions: ugo+rw Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-37c32bf0-fd8a-4cbe-a707-79de7db61e4b tempest-VolumeDependencyTests-1010503134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:44 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.info Sep 07 14:04:44 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-dbbc7228-07b4-429c-93f7-17567b09fa02 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-dbbc7228-07b4-429c-93f7-17567b09fa02 tempest-ProjectReaderTests-2123950541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-dbbc7228-07b4-429c-93f7-17567b09fa02 tempest-ProjectReaderTests-2123950541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-dbbc7228-07b4-429c-93f7-17567b09fa02 tempest-ProjectReaderTests-2123950541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-dbbc7228-07b4-429c-93f7-17567b09fa02 tempest-ProjectReaderTests-2123950541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dbbc7228-07b4-429c-93f7-17567b09fa02 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:44 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:44 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Flow 'volume_create_manager' (2341aedc-5286-452d-b2df-18d6f0768ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c478a52e-2bb9-4e0e-aee1-8ab66fc5f30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c478a52e-2bb9-4e0e-aee1-8ab66fc5f30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-203279310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef360da-0b36-4b5b-89cd-5a180eeff382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd80b19127894f05b2b6f5083736d0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:44Z,use_quota=True,user_id='36f25a4a1cef480d9fbafc336f2af6b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:44 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f75e65-6a18-4865-996c-c6d5b40a3ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f75e65-6a18-4865-996c-c6d5b40a3ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa9aeed-1b64-4e97-814f-821b2a7c9405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa9aeed-1b64-4e97-814f-821b2a7c9405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ef360da-0b36-4b5b-89cd-5a180eeff382', 'volume_name': 'volume-0ef360da-0b36-4b5b-89cd-5a180eeff382', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae81a86e-2386-4f30-9121-27fe354eb335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae81a86e-2386-4f30-9121-27fe354eb335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75f6270-9d32-47ab-a4a0-138fb6377fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:44 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Volume 0ef360da-0b36-4b5b-89cd-5a180eeff382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ef360da-0b36-4b5b-89cd-5a180eeff382', 'volume_size': 1} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-37c32bf0-fd8a-4cbe-a707-79de7db61e4b tempest-VolumeDependencyTests-1010503134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.info" returned: 0 in 0.354s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-37c32bf0-fd8a-4cbe-a707-79de7db61e4b tempest-VolumeDependencyTests-1010503134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.215s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7ea91dba-c508-4cc5-9983-646a4275d52d tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.250s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-7ea91dba-c508-4cc5-9983-646a4275d52d tempest-ProjectMemberTests-1858363890 None] Creating offline snapshot ea90703f-b0ab-4f98-bce6-333207a365af of volume d5ce8c9d-60b1-4563-8b47-5cc5032425cd {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:04:44 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dbbc7228-07b4-429c-93f7-17567b09fa02 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.350s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-dbbc7228-07b4-429c-93f7-17567b09fa02 tempest-ProjectReaderTests-2123950541 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:44 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-dbbc7228-07b4-429c-93f7-17567b09fa02 tempest-ProjectReaderTests-2123950541 None] Deleted volume successfully. Sep 07 14:04:44 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-37c32bf0-fd8a-4cbe-a707-79de7db61e4b tempest-VolumeDependencyTests-1010503134 None] Create snapshot completed successfully Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea7fdba-13e4-4cde-ac44-b9d745c9c236]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7ea91dba-c508-4cc5-9983-646a4275d52d tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dbbc7228-07b4-429c-93f7-17567b09fa02 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-8cc4f618-07df-45c6-8c50-11b95985ea63-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:44 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd Sep 07 14:04:44 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Flow 'volume_create_manager' (95e49188-26e2-41c2-b833-a2d9ea93c8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:44 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5459e04-fca0-42b9-9738-4b64ec0b2c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7ea91dba-c508-4cc5-9983-646a4275d52d tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd" returned: 0 in 0.435s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7ea91dba-c508-4cc5-9983-646a4275d52d tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.ea90703f-b0ab-4f98-bce6-333207a365af 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:44 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.ea90703f-b0ab-4f98-bce6-333207a365af 1G Sep 07 14:04:44 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5459e04-fca0-42b9-9738-4b64ec0b2c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1859351130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f9c878-6df5-417e-a627-75ddb68cc203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f88686a757b48d2ac1a60b2911cabe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:45Z,use_quota=True,user_id='28a72580cb7e409aa7c0843102d083c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43396a81-4f3b-42f3-871b-dbf844bf968e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43396a81-4f3b-42f3-871b-dbf844bf968e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0f2575-7bcb-4078-9f60-148294102045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0f2575-7bcb-4078-9f60-148294102045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84f9c878-6df5-417e-a627-75ddb68cc203', 'volume_name': 'volume-84f9c878-6df5-417e-a627-75ddb68cc203', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e29cc5-3aa4-453f-8665-a2c56f192050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e29cc5-3aa4-453f-8665-a2c56f192050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1556d2dd-e2ab-4a09-9307-a8bde6e0ca26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:44 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Volume 84f9c878-6df5-417e-a627-75ddb68cc203: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84f9c878-6df5-417e-a627-75ddb68cc203', 'volume_size': 1} Sep 07 14:04:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:45 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:45 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Flow 'volume_create_manager' (2307c144-c0d8-43d8-83a3-eafe15639f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:45 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffccf5c5-faf6-4f16-a62b-051f7c7fe4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:45 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffccf5c5-faf6-4f16-a62b-051f7c7fe4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-127647273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd2c712-33e0-4c9e-92bf-dee007a7bc5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70cdd4dbcadd46409e6bd5a1b28d635b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=500150e2-3c27-4dc9-84c6-95fdd290c02c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:45Z,use_quota=True,user_id='e9f2a2d2d37841afbf9d9d10c403960f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:45 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5b4301-4f1f-474d-9b44-9c2a939b6d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:45 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5b4301-4f1f-474d-9b44-9c2a939b6d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:45 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:45 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58859e0a-bd18-4edf-8d25-30ac1a758644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:45 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58859e0a-bd18-4edf-8d25-30ac1a758644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bbd2c712-33e0-4c9e-92bf-dee007a7bc5f', 'volume_name': 'volume-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f', 'volume_size': 1, 'snapshot_id': '500150e2-3c27-4dc9-84c6-95fdd290c02c'}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:45 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd1c0ac-3add-4d23-af9f-0fe49065c286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:45 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd1c0ac-3add-4d23-af9f-0fe49065c286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:45 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b8394b-b93a-4aad-9e9f-5d5f59f92307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:45 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Volume bbd2c712-33e0-4c9e-92bf-dee007a7bc5f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f', 'volume_size': 1, 'snapshot_id': '500150e2-3c27-4dc9-84c6-95fdd290c02c'} Sep 07 14:04:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7ea91dba-c508-4cc5-9983-646a4275d52d tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.ea90703f-b0ab-4f98-bce6-333207a365af 1G" returned: 0 in 0.473s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7ea91dba-c508-4cc5-9983-646a4275d52d tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.ea90703f-b0ab-4f98-bce6-333207a365af {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:45 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.ea90703f-b0ab-4f98-bce6-333207a365af Sep 07 14:04:45 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:45 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7ea91dba-c508-4cc5-9983-646a4275d52d tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.ea90703f-b0ab-4f98-bce6-333207a365af" returned: 0 in 0.262s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:45 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-7ea91dba-c508-4cc5-9983-646a4275d52d tempest-ProjectMemberTests-1858363890 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.ea90703f-b0ab-4f98-bce6-333207a365af is being set with open permissions: ugo+rw Sep 07 14:04:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7ea91dba-c508-4cc5-9983-646a4275d52d tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.ea90703f-b0ab-4f98-bce6-333207a365af {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:45 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.ea90703f-b0ab-4f98-bce6-333207a365af Sep 07 14:04:45 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:45 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7ea91dba-c508-4cc5-9983-646a4275d52d tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.ea90703f-b0ab-4f98-bce6-333207a365af" returned: 0 in 0.231s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7ea91dba-c508-4cc5-9983-646a4275d52d tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:45 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.info Sep 07 14:04:45 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:46 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7ea91dba-c508-4cc5-9983-646a4275d52d tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.info" returned: 0 in 0.231s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:46 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-7ea91dba-c508-4cc5-9983-646a4275d52d tempest-ProjectMemberTests-1858363890 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.info is being set with open permissions: ugo+rw Sep 07 14:04:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7ea91dba-c508-4cc5-9983-646a4275d52d tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:46 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.info Sep 07 14:04:46 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:46 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7ea91dba-c508-4cc5-9983-646a4275d52d tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.info" returned: 0 in 0.232s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-7ea91dba-c508-4cc5-9983-646a4275d52d tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.959s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.999s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:46 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-203279310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef360da-0b36-4b5b-89cd-5a180eeff382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd80b19127894f05b2b6f5083736d0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:44Z,use_quota=True,user_id='36f25a4a1cef480d9fbafc336f2af6b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:46 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Creating volume 0ef360da-0b36-4b5b-89cd-5a180eeff382 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:46 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:46 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:46 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:46 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0ef360da-0b36-4b5b-89cd-5a180eeff382 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:46 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0ef360da-0b36-4b5b-89cd-5a180eeff382 1073741824 Sep 07 14:04:46 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:46 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-7ea91dba-c508-4cc5-9983-646a4275d52d tempest-ProjectMemberTests-1858363890 None] Create snapshot completed successfully Sep 07 14:04:46 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0ef360da-0b36-4b5b-89cd-5a180eeff382 1073741824" returned: 0 in 0.377s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0ef360da-0b36-4b5b-89cd-5a180eeff382 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:46 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0ef360da-0b36-4b5b-89cd-5a180eeff382 Sep 07 14:04:46 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:46 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0ef360da-0b36-4b5b-89cd-5a180eeff382" returned: 0 in 0.231s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:46 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] <== create_volume: return (642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.645s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.063s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1859351130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f9c878-6df5-417e-a627-75ddb68cc203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f88686a757b48d2ac1a60b2911cabe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:45Z,use_quota=True,user_id='28a72580cb7e409aa7c0843102d083c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Creating volume 84f9c878-6df5-417e-a627-75ddb68cc203 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:47 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75f6270-9d32-47ab-a4a0-138fb6377fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ef360da-0b36-4b5b-89cd-5a180eeff382', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:47 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203 1073741824 Sep 07 14:04:47 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51afc090-9b45-4468-b5de-19590b7c2cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:47 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Volume volume-0ef360da-0b36-4b5b-89cd-5a180eeff382 (0ef360da-0b36-4b5b-89cd-5a180eeff382): created successfully Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51afc090-9b45-4468-b5de-19590b7c2cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Flow 'volume_create_manager' (2341aedc-5286-452d-b2df-18d6f0768ee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:47 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-9bbae8bf-7924-4145-aaca-c7ca7ae2548b tempest-ProjectReaderTests-841007551 None] Created volume successfully. Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f19d0574-34e7-428c-a8a5-79eee2358520 tempest-ProjectReaderTests-841007551 None] Acquiring lock "cinder-0ef360da-0b36-4b5b-89cd-5a180eeff382-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b0db6a0d-f9c3-4a1e-9204-9771f964af25 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-ea90703f-b0ab-4f98-bce6-333207a365af-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f19d0574-34e7-428c-a8a5-79eee2358520 tempest-ProjectReaderTests-841007551 None] Lock "cinder-0ef360da-0b36-4b5b-89cd-5a180eeff382-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b0db6a0d-f9c3-4a1e-9204-9771f964af25 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-ea90703f-b0ab-4f98-bce6-333207a365af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b0db6a0d-f9c3-4a1e-9204-9771f964af25 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-d5ce8c9d-60b1-4563-8b47-5cc5032425cd" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b0db6a0d-f9c3-4a1e-9204-9771f964af25 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-d5ce8c9d-60b1-4563-8b47-5cc5032425cd" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b0db6a0d-f9c3-4a1e-9204-9771f964af25 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-ea90703f-b0ab-4f98-bce6-333207a365af" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f19d0574-34e7-428c-a8a5-79eee2358520 tempest-ProjectReaderTests-841007551 None] Acquiring lock "cinder-quobyte-0ef360da-0b36-4b5b-89cd-5a180eeff382" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b0db6a0d-f9c3-4a1e-9204-9771f964af25 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-ea90703f-b0ab-4f98-bce6-333207a365af" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-b0db6a0d-f9c3-4a1e-9204-9771f964af25 tempest-ProjectMemberTests-1858363890 None] Deleting offline snapshot ea90703f-b0ab-4f98-bce6-333207a365af of volume d5ce8c9d-60b1-4563-8b47-5cc5032425cd {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-b0db6a0d-f9c3-4a1e-9204-9771f964af25 tempest-ProjectMemberTests-1858363890 None] snapshot_file for this snap is: volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.ea90703f-b0ab-4f98-bce6-333207a365af {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f19d0574-34e7-428c-a8a5-79eee2358520 tempest-ProjectReaderTests-841007551 None] Lock "cinder-quobyte-0ef360da-0b36-4b5b-89cd-5a180eeff382" acquired by "delete_volume" :: waited 0.035s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:47 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef9e28e-b957-4a2a-998b-a1cf8ffdfd1b]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b0db6a0d-f9c3-4a1e-9204-9771f964af25 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.ea90703f-b0ab-4f98-bce6-333207a365af {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203 1073741824" returned: 0 in 0.522s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8979813f-18f3-4ec8-96a8-e237d0ab02d0]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f19d0574-34e7-428c-a8a5-79eee2358520 tempest-ProjectReaderTests-841007551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0ef360da-0b36-4b5b-89cd-5a180eeff382 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:47 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203 Sep 07 14:04:47 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:47 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.ea90703f-b0ab-4f98-bce6-333207a365af Sep 07 14:04:47 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:47 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0ef360da-0b36-4b5b-89cd-5a180eeff382 Sep 07 14:04:47 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:47 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203" returned: 0 in 0.249s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.467s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Acquiring lock "cinder-quobyte-500150e2-3c27-4dc9-84c6-95fdd290c02c-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f" by "_create_volume_from_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1556d2dd-e2ab-4a09-9307-a8bde6e0ca26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84f9c878-6df5-417e-a627-75ddb68cc203', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee3a272-75ea-4292-9c39-344782b70814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Lock "cinder-quobyte-500150e2-3c27-4dc9-84c6-95fdd290c02c-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Creating volume bbd2c712-33e0-4c9e-92bf-dee007a7bc5f from snapshot 500150e2-3c27-4dc9-84c6-95fdd290c02c {{(pid=87571) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Acquiring lock "cinder-quobyte-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f" by "_copy_volume_from_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:47 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Volume volume-84f9c878-6df5-417e-a627-75ddb68cc203 (84f9c878-6df5-417e-a627-75ddb68cc203): created successfully Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee3a272-75ea-4292-9c39-344782b70814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Flow 'volume_create_manager' (95e49188-26e2-41c2-b833-a2d9ea93c8b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Lock "cinder-quobyte-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] snapshot: 500150e2-3c27-4dc9-84c6-95fdd290c02c, volume: bbd2c712-33e0-4c9e-92bf-dee007a7bc5f, {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 14:04:47 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-0745d84b-0b21-4c08-a415-7eea9007a7ee tempest-ProjectReaderTests-2123950541 None] Created volume successfully. Sep 07 14:04:47 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b0db6a0d-f9c3-4a1e-9204-9771f964af25 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.ea90703f-b0ab-4f98-bce6-333207a365af" returned: 0 in 0.411s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-b0db6a0d-f9c3-4a1e-9204-9771f964af25 tempest-ProjectMemberTests-1858363890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:04:47 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4a95f9-1d53-49c4-b2ee-0f62b0980ad0]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b0db6a0d-f9c3-4a1e-9204-9771f964af25 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[86121cde-2ba4-49f6-904e-8ae07613abc2]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f19d0574-34e7-428c-a8a5-79eee2358520 tempest-ProjectReaderTests-841007551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0ef360da-0b36-4b5b-89cd-5a180eeff382" returned: 0 in 0.449s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.500150e2-3c27-4dc9-84c6-95fdd290c02c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f19d0574-34e7-428c-a8a5-79eee2358520 tempest-ProjectReaderTests-841007551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0ef360da-0b36-4b5b-89cd-5a180eeff382 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:48 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0ef360da-0b36-4b5b-89cd-5a180eeff382 Sep 07 14:04:48 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:48 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd Sep 07 14:04:48 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:48 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.500150e2-3c27-4dc9-84c6-95fdd290c02c Sep 07 14:04:48 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:48 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f19d0574-34e7-428c-a8a5-79eee2358520 tempest-ProjectReaderTests-841007551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0ef360da-0b36-4b5b-89cd-5a180eeff382" returned: 0 in 0.258s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f19d0574-34e7-428c-a8a5-79eee2358520 tempest-ProjectReaderTests-841007551 None] Lock "cinder-quobyte-0ef360da-0b36-4b5b-89cd-5a180eeff382" released by "delete_volume" :: held 0.760s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-f19d0574-34e7-428c-a8a5-79eee2358520 tempest-ProjectReaderTests-841007551 None] Created reservations ['7eda03bc-95ea-4bae-a300-0dccc7abe6c1', '9545e78a-134f-4d43-bb7e-f3369d89e1ae', 'a7802fbc-ff64-406d-98c7-61856724767b', 'c3866306-7277-4c7c-beb0-cc43f02f51d2'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:48 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b0db6a0d-f9c3-4a1e-9204-9771f964af25 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd" returned: 0 in 0.395s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b0db6a0d-f9c3-4a1e-9204-9771f964af25 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.ea90703f-b0ab-4f98-bce6-333207a365af {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:48 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.500150e2-3c27-4dc9-84c6-95fdd290c02c" returned: 0 in 0.397s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-133e3509-862e-48a6-94cc-6b47084717fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:04:48 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.ea90703f-b0ab-4f98-bce6-333207a365af Sep 07 14:04:48 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd901c6c-bc42-4508-809f-8168a2ae7822]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f19d0574-34e7-428c-a8a5-79eee2358520 tempest-ProjectReaderTests-841007551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f19d0574-34e7-428c-a8a5-79eee2358520 tempest-ProjectReaderTests-841007551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f19d0574-34e7-428c-a8a5-79eee2358520 tempest-ProjectReaderTests-841007551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f19d0574-34e7-428c-a8a5-79eee2358520 tempest-ProjectReaderTests-841007551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f19d0574-34e7-428c-a8a5-79eee2358520 tempest-ProjectReaderTests-841007551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f19d0574-34e7-428c-a8a5-79eee2358520 tempest-ProjectReaderTests-841007551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:48 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:48 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:48 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc Sep 07 14:04:48 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:48 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f19d0574-34e7-428c-a8a5-79eee2358520 tempest-ProjectReaderTests-841007551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.259s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-f19d0574-34e7-428c-a8a5-79eee2358520 tempest-ProjectReaderTests-841007551 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:48 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-f19d0574-34e7-428c-a8a5-79eee2358520 tempest-ProjectReaderTests-841007551 None] Deleted volume successfully. Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f19d0574-34e7-428c-a8a5-79eee2358520 tempest-ProjectReaderTests-841007551 None] Lock "cinder-0ef360da-0b36-4b5b-89cd-5a180eeff382-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:48 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b0db6a0d-f9c3-4a1e-9204-9771f964af25 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.ea90703f-b0ab-4f98-bce6-333207a365af" returned: 0 in 0.401s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b0db6a0d-f9c3-4a1e-9204-9771f964af25 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.ea90703f-b0ab-4f98-bce6-333207a365af {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:48 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc" returned: 0 in 0.391s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Creating direct copy from snapshot {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 14:04:48 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.ea90703f-b0ab-4f98-bce6-333207a365af Sep 07 14:04:48 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG cinder.utils [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Path /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f not found in is_blk_device check {{(pid=87571) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 14:04:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:48 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f Sep 07 14:04:48 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:49 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b0db6a0d-f9c3-4a1e-9204-9771f964af25 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd.ea90703f-b0ab-4f98-bce6-333207a365af" returned: 0 in 0.311s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:49 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b0db6a0d-f9c3-4a1e-9204-9771f964af25 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-ea90703f-b0ab-4f98-bce6-333207a365af" released by "_delete_snapshot" :: held 1.677s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:49 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Flow 'volume_create_manager' (1c504b82-84b1-449c-8387-4f1184f2e170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba192b2-ce74-41c4-a4b5-60251b157d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:49 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b0db6a0d-f9c3-4a1e-9204-9771f964af25 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-d5ce8c9d-60b1-4563-8b47-5cc5032425cd" released by "delete_snapshot" :: held 1.753s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba192b2-ce74-41c4-a4b5-60251b157d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-328801311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0402a57d-5e6b-461f-93bb-495c61241f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd80b19127894f05b2b6f5083736d0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:49Z,use_quota=True,user_id='36f25a4a1cef480d9fbafc336f2af6b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2ce2ca-317a-4ca1-b198-69ff3d43aeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2ce2ca-317a-4ca1-b198-69ff3d43aeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9837bb0d-180f-495f-be0f-ecd39cc85587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9837bb0d-180f-495f-be0f-ecd39cc85587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0402a57d-5e6b-461f-93bb-495c61241f22', 'volume_name': 'volume-0402a57d-5e6b-461f-93bb-495c61241f22', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a9e382-cc45-4102-8e88-a848ff1b0201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a9e382-cc45-4102-8e88-a848ff1b0201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:49 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447dec4e-eb45-4136-b7f0-681c3ca9e26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:49 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Volume 0402a57d-5e6b-461f-93bb-495c61241f22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0402a57d-5e6b-461f-93bb-495c61241f22', 'volume_size': 1} Sep 07 14:04:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f3b54eaa-640b-4ab0-a6e4-d24b5c96d9cd tempest-ProjectReaderTests-2123950541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:49 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-b0db6a0d-f9c3-4a1e-9204-9771f964af25 tempest-ProjectMemberTests-1858363890 None] Created reservations ['694f1420-640a-43da-b0c2-5fb3c2645660', '52bc0d7b-8e05-4bb9-8bf5-815bc16cf8f6', '9082b18f-58bd-491f-80cd-9e5d9cd91028', '6333bafa-d547-43f4-b019-c452819a6773'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:49 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-b0db6a0d-f9c3-4a1e-9204-9771f964af25 tempest-ProjectMemberTests-1858363890 None] Delete snapshot completed successfully. Sep 07 14:04:49 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-b0db6a0d-f9c3-4a1e-9204-9771f964af25 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-ea90703f-b0ab-4f98-bce6-333207a365af-delete_snapshot" released by "delete_snapshot" :: held 2.131s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:49 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6cc16c43-0b64-4c5f-8be4-2d1a27d37264 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-d5ce8c9d-60b1-4563-8b47-5cc5032425cd-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:49 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6cc16c43-0b64-4c5f-8be4-2d1a27d37264 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-d5ce8c9d-60b1-4563-8b47-5cc5032425cd-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:49 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6cc16c43-0b64-4c5f-8be4-2d1a27d37264 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-d5ce8c9d-60b1-4563-8b47-5cc5032425cd" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:49 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6cc16c43-0b64-4c5f-8be4-2d1a27d37264 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-d5ce8c9d-60b1-4563-8b47-5cc5032425cd" acquired by "delete_volume" :: waited 0.028s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:50 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be7834b-b688-495b-a3e6-8aed05054222]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6cc16c43-0b64-4c5f-8be4-2d1a27d37264 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:50 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd Sep 07 14:04:50 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:50 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6cc16c43-0b64-4c5f-8be4-2d1a27d37264 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd" returned: 0 in 0.830s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6cc16c43-0b64-4c5f-8be4-2d1a27d37264 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:50 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd Sep 07 14:04:50 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:51 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6cc16c43-0b64-4c5f-8be4-2d1a27d37264 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d5ce8c9d-60b1-4563-8b47-5cc5032425cd" returned: 0 in 0.394s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:51 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6cc16c43-0b64-4c5f-8be4-2d1a27d37264 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-d5ce8c9d-60b1-4563-8b47-5cc5032425cd" released by "delete_volume" :: held 1.368s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:51 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-6cc16c43-0b64-4c5f-8be4-2d1a27d37264 tempest-ProjectMemberTests-1858363890 None] Created reservations ['3e45cd74-fcad-4465-8e5d-625af6ea06fb', '55f41fcd-6a76-4c10-98d3-4474c2145692', 'd1d22c41-0674-45b4-8c61-1ebf7e66b108', '023915e4-479a-4b89-ba8a-8eee3f18dc06'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6cc16c43-0b64-4c5f-8be4-2d1a27d37264 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6cc16c43-0b64-4c5f-8be4-2d1a27d37264 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-6cc16c43-0b64-4c5f-8be4-2d1a27d37264 tempest-ProjectMemberTests-1858363890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:51 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-6cc16c43-0b64-4c5f-8be4-2d1a27d37264 tempest-ProjectMemberTests-1858363890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6cc16c43-0b64-4c5f-8be4-2d1a27d37264 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:51 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6cc16c43-0b64-4c5f-8be4-2d1a27d37264 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:51 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:51 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:52 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6cc16c43-0b64-4c5f-8be4-2d1a27d37264 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.623s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:52 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-6cc16c43-0b64-4c5f-8be4-2d1a27d37264 tempest-ProjectMemberTests-1858363890 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:52 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-6cc16c43-0b64-4c5f-8be4-2d1a27d37264 tempest-ProjectMemberTests-1858363890 None] Deleted volume successfully. Sep 07 14:04:52 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6cc16c43-0b64-4c5f-8be4-2d1a27d37264 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-d5ce8c9d-60b1-4563-8b47-5cc5032425cd-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Flow 'volume_create_manager' (d926670d-f9ef-4e28-8d09-caf69a6f9a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145ded1b-9231-493e-88d7-9ae2cc9b301d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145ded1b-9231-493e-88d7-9ae2cc9b301d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-761939170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e4ad2d9-cc15-4b99-b713-98e1134deb90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8fd9674bb249b899d5c69373880941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:53Z,use_quota=True,user_id='30c462f1a0094053b9f39392ba6e3442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c1ccad3-9d27-43f2-b696-d5cc6097fbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c1ccad3-9d27-43f2-b696-d5cc6097fbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ccb159-f9fb-4685-9aa1-34be76b62d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ccb159-f9fb-4685-9aa1-34be76b62d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e4ad2d9-cc15-4b99-b713-98e1134deb90', 'volume_name': 'volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec514f07-0ca0-4e56-93b2-e9027436b541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec514f07-0ca0-4e56-93b2-e9027436b541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4615870-75e1-46a4-a491-84f9f5829aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:53 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Volume 1e4ad2d9-cc15-4b99-b713-98e1134deb90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90', 'volume_size': 1} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:53 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f" returned: 0 in 4.828s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc, size 1024.00 MB, duration 4.83 sec, destination /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 14:04:53 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Converted 1024.00 MB image at 212.04 MB/s Sep 07 14:04:53 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f is being set with open permissions: ugo+rw Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:53 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f Sep 07 14:04:53 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:53 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f" returned: 0 in 0.235s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Lock "cinder-quobyte-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f" released by "_copy_volume_from_snapshot" :: held 5.971s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Lock "cinder-quobyte-500150e2-3c27-4dc9-84c6-95fdd290c02c-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f" released by "_create_volume_from_snapshot" :: held 6.062s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.097s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.650s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-328801311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0402a57d-5e6b-461f-93bb-495c61241f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd80b19127894f05b2b6f5083736d0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:49Z,use_quota=True,user_id='36f25a4a1cef480d9fbafc336f2af6b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Creating volume 0402a57d-5e6b-461f-93bb-495c61241f22 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:53 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0402a57d-5e6b-461f-93bb-495c61241f22 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:53 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0402a57d-5e6b-461f-93bb-495c61241f22 1073741824 Sep 07 14:04:53 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b8394b-b93a-4aad-9e9f-5d5f59f92307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f', 'volume_size': 1, 'snapshot_id': '500150e2-3c27-4dc9-84c6-95fdd290c02c'}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:53 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14863eb8-79d8-49a2-b945-4f419440476d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:53 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Volume volume-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f (bbd2c712-33e0-4c9e-92bf-dee007a7bc5f): created successfully Sep 07 14:04:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14863eb8-79d8-49a2-b945-4f419440476d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Flow 'volume_create_manager' (2307c144-c0d8-43d8-83a3-eafe15639f16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:54 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-4409a981-9068-4c83-b0e1-9df7753a7177 tempest-VolumeDependencyTests-1010503134 None] Created volume successfully. Sep 07 14:04:54 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0402a57d-5e6b-461f-93bb-495c61241f22 1073741824" returned: 0 in 0.416s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0402a57d-5e6b-461f-93bb-495c61241f22 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:54 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0402a57d-5e6b-461f-93bb-495c61241f22 Sep 07 14:04:54 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:54 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0402a57d-5e6b-461f-93bb-495c61241f22" returned: 0 in 0.232s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:54 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f3b54eaa-640b-4ab0-a6e4-d24b5c96d9cd tempest-ProjectReaderTests-2123950541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.314s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447dec4e-eb45-4136-b7f0-681c3ca9e26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0402a57d-5e6b-461f-93bb-495c61241f22', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07bd499-5164-4951-85dc-564232052474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:54 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-f3b54eaa-640b-4ab0-a6e4-d24b5c96d9cd tempest-ProjectReaderTests-2123950541 None] Creating offline snapshot 36d9d29f-12f4-42c4-936e-a87a4a8fd981 of volume 84f9c878-6df5-417e-a627-75ddb68cc203 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:04:54 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Volume volume-0402a57d-5e6b-461f-93bb-495c61241f22 (0402a57d-5e6b-461f-93bb-495c61241f22): created successfully Sep 07 14:04:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07bd499-5164-4951-85dc-564232052474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:54 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Flow 'volume_create_manager' (1c504b82-84b1-449c-8387-4f1184f2e170) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:54 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0a8888-a40f-45ab-9d63-c1667af9596e]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f3b54eaa-640b-4ab0-a6e4-d24b5c96d9cd tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:54 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-4c7a788e-40e9-4a8f-bc0b-060f543e0ac7 tempest-ProjectReaderTests-841007551 None] Created volume successfully. Sep 07 14:04:54 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203 Sep 07 14:04:54 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-90c30ddc-a3ed-49c0-ab7e-a722f5a75151 tempest-ProjectReaderTests-841007551 None] Acquiring lock "cinder-0402a57d-5e6b-461f-93bb-495c61241f22-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-90c30ddc-a3ed-49c0-ab7e-a722f5a75151 tempest-ProjectReaderTests-841007551 None] Lock "cinder-0402a57d-5e6b-461f-93bb-495c61241f22-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-90c30ddc-a3ed-49c0-ab7e-a722f5a75151 tempest-ProjectReaderTests-841007551 None] Acquiring lock "cinder-quobyte-0402a57d-5e6b-461f-93bb-495c61241f22" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-90c30ddc-a3ed-49c0-ab7e-a722f5a75151 tempest-ProjectReaderTests-841007551 None] Lock "cinder-quobyte-0402a57d-5e6b-461f-93bb-495c61241f22" acquired by "delete_volume" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:54 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc4cb26-c030-4c44-987a-e1bb2cf99445]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-90c30ddc-a3ed-49c0-ab7e-a722f5a75151 tempest-ProjectReaderTests-841007551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0402a57d-5e6b-461f-93bb-495c61241f22 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:55 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f3b54eaa-640b-4ab0-a6e4-d24b5c96d9cd tempest-ProjectReaderTests-2123950541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203" returned: 0 in 0.375s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f3b54eaa-640b-4ab0-a6e4-d24b5c96d9cd tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.36d9d29f-12f4-42c4-936e-a87a4a8fd981 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:55 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0402a57d-5e6b-461f-93bb-495c61241f22 Sep 07 14:04:55 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.36d9d29f-12f4-42c4-936e-a87a4a8fd981 1G Sep 07 14:04:55 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:55 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f434f5d2-d674-43ab-b700-2d1a3f55d181 tempest-VolumeDependencyTests-1010503134 None] Acquiring lock "cinder-500150e2-3c27-4dc9-84c6-95fdd290c02c-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f434f5d2-d674-43ab-b700-2d1a3f55d181 tempest-VolumeDependencyTests-1010503134 None] Lock "cinder-500150e2-3c27-4dc9-84c6-95fdd290c02c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f434f5d2-d674-43ab-b700-2d1a3f55d181 tempest-VolumeDependencyTests-1010503134 None] Acquiring lock "cinder-quobyte-133e3509-862e-48a6-94cc-6b47084717fc" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f434f5d2-d674-43ab-b700-2d1a3f55d181 tempest-VolumeDependencyTests-1010503134 None] Lock "cinder-quobyte-133e3509-862e-48a6-94cc-6b47084717fc" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f434f5d2-d674-43ab-b700-2d1a3f55d181 tempest-VolumeDependencyTests-1010503134 None] Acquiring lock "cinder-quobyte-500150e2-3c27-4dc9-84c6-95fdd290c02c" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f434f5d2-d674-43ab-b700-2d1a3f55d181 tempest-VolumeDependencyTests-1010503134 None] Lock "cinder-quobyte-500150e2-3c27-4dc9-84c6-95fdd290c02c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-f434f5d2-d674-43ab-b700-2d1a3f55d181 tempest-VolumeDependencyTests-1010503134 None] Deleting offline snapshot 500150e2-3c27-4dc9-84c6-95fdd290c02c of volume 133e3509-862e-48a6-94cc-6b47084717fc {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-f434f5d2-d674-43ab-b700-2d1a3f55d181 tempest-VolumeDependencyTests-1010503134 None] snapshot_file for this snap is: volume-133e3509-862e-48a6-94cc-6b47084717fc.500150e2-3c27-4dc9-84c6-95fdd290c02c {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed61917-463b-40ec-bcfa-e14e8fa13734]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f434f5d2-d674-43ab-b700-2d1a3f55d181 tempest-VolumeDependencyTests-1010503134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.500150e2-3c27-4dc9-84c6-95fdd290c02c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:55 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.500150e2-3c27-4dc9-84c6-95fdd290c02c Sep 07 14:04:55 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:55 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-90c30ddc-a3ed-49c0-ab7e-a722f5a75151 tempest-ProjectReaderTests-841007551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0402a57d-5e6b-461f-93bb-495c61241f22" returned: 0 in 0.422s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-90c30ddc-a3ed-49c0-ab7e-a722f5a75151 tempest-ProjectReaderTests-841007551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0402a57d-5e6b-461f-93bb-495c61241f22 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:55 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0402a57d-5e6b-461f-93bb-495c61241f22 Sep 07 14:04:55 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:55 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f3b54eaa-640b-4ab0-a6e4-d24b5c96d9cd tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.36d9d29f-12f4-42c4-936e-a87a4a8fd981 1G" returned: 0 in 0.492s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f3b54eaa-640b-4ab0-a6e4-d24b5c96d9cd tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84f9c878-6df5-417e-a627-75ddb68cc203 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.36d9d29f-12f4-42c4-936e-a87a4a8fd981 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:55 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84f9c878-6df5-417e-a627-75ddb68cc203 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.36d9d29f-12f4-42c4-936e-a87a4a8fd981 Sep 07 14:04:55 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:55 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f434f5d2-d674-43ab-b700-2d1a3f55d181 tempest-VolumeDependencyTests-1010503134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.500150e2-3c27-4dc9-84c6-95fdd290c02c" returned: 0 in 0.386s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-f434f5d2-d674-43ab-b700-2d1a3f55d181 tempest-VolumeDependencyTests-1010503134 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-133e3509-862e-48a6-94cc-6b47084717fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:04:55 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-90c30ddc-a3ed-49c0-ab7e-a722f5a75151 tempest-ProjectReaderTests-841007551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0402a57d-5e6b-461f-93bb-495c61241f22" returned: 0 in 0.266s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[acaac4f5-0de1-49a3-8cfc-7bde6cff3503]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f434f5d2-d674-43ab-b700-2d1a3f55d181 tempest-VolumeDependencyTests-1010503134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-90c30ddc-a3ed-49c0-ab7e-a722f5a75151 tempest-ProjectReaderTests-841007551 None] Lock "cinder-quobyte-0402a57d-5e6b-461f-93bb-495c61241f22" released by "delete_volume" :: held 0.735s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-90c30ddc-a3ed-49c0-ab7e-a722f5a75151 tempest-ProjectReaderTests-841007551 None] Created reservations ['04d80787-659d-45fe-aed9-3dcafa0736b0', 'a8e268ec-3b5a-477a-968f-19c32fb19cfb', '4393977d-88d2-4d9d-a759-d67693155c64', '1d243e17-32ed-462e-9f37-edb98d35068b'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:55 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc Sep 07 14:04:55 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-90c30ddc-a3ed-49c0-ab7e-a722f5a75151 tempest-ProjectReaderTests-841007551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-90c30ddc-a3ed-49c0-ab7e-a722f5a75151 tempest-ProjectReaderTests-841007551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-90c30ddc-a3ed-49c0-ab7e-a722f5a75151 tempest-ProjectReaderTests-841007551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-90c30ddc-a3ed-49c0-ab7e-a722f5a75151 tempest-ProjectReaderTests-841007551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-90c30ddc-a3ed-49c0-ab7e-a722f5a75151 tempest-ProjectReaderTests-841007551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-90c30ddc-a3ed-49c0-ab7e-a722f5a75151 tempest-ProjectReaderTests-841007551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:55 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:55 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:55 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f3b54eaa-640b-4ab0-a6e4-d24b5c96d9cd tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84f9c878-6df5-417e-a627-75ddb68cc203 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.36d9d29f-12f4-42c4-936e-a87a4a8fd981" returned: 0 in 0.313s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:55 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-f3b54eaa-640b-4ab0-a6e4-d24b5c96d9cd tempest-ProjectReaderTests-2123950541 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.36d9d29f-12f4-42c4-936e-a87a4a8fd981 is being set with open permissions: ugo+rw Sep 07 14:04:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f3b54eaa-640b-4ab0-a6e4-d24b5c96d9cd tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.36d9d29f-12f4-42c4-936e-a87a4a8fd981 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:55 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.36d9d29f-12f4-42c4-936e-a87a4a8fd981 Sep 07 14:04:55 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:56 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-90c30ddc-a3ed-49c0-ab7e-a722f5a75151 tempest-ProjectReaderTests-841007551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.268s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-90c30ddc-a3ed-49c0-ab7e-a722f5a75151 tempest-ProjectReaderTests-841007551 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:56 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-90c30ddc-a3ed-49c0-ab7e-a722f5a75151 tempest-ProjectReaderTests-841007551 None] Deleted volume successfully. Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-90c30ddc-a3ed-49c0-ab7e-a722f5a75151 tempest-ProjectReaderTests-841007551 None] Lock "cinder-0402a57d-5e6b-461f-93bb-495c61241f22-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:56 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f3b54eaa-640b-4ab0-a6e4-d24b5c96d9cd tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.36d9d29f-12f4-42c4-936e-a87a4a8fd981" returned: 0 in 0.271s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f3b54eaa-640b-4ab0-a6e4-d24b5c96d9cd tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:56 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.info Sep 07 14:04:56 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:56 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f434f5d2-d674-43ab-b700-2d1a3f55d181 tempest-VolumeDependencyTests-1010503134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc" returned: 0 in 0.656s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f434f5d2-d674-43ab-b700-2d1a3f55d181 tempest-VolumeDependencyTests-1010503134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.500150e2-3c27-4dc9-84c6-95fdd290c02c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:56 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.500150e2-3c27-4dc9-84c6-95fdd290c02c Sep 07 14:04:56 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:56 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f3b54eaa-640b-4ab0-a6e4-d24b5c96d9cd tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.info" returned: 0 in 0.323s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:56 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-f3b54eaa-640b-4ab0-a6e4-d24b5c96d9cd tempest-ProjectReaderTests-2123950541 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.info is being set with open permissions: ugo+rw Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f3b54eaa-640b-4ab0-a6e4-d24b5c96d9cd tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:56 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.info Sep 07 14:04:56 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Flow 'volume_create_manager' (98186898-af81-48b3-9a23-e1e6a407ff31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (321b8a38-241a-4334-8ec1-75ea13429521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (321b8a38-241a-4334-8ec1-75ea13429521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1849552107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cf8ec0c-7303-4308-9d1c-dcda90f6e698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd80b19127894f05b2b6f5083736d0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:57Z,use_quota=True,user_id='36f25a4a1cef480d9fbafc336f2af6b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c30c53-b329-407e-bbe9-a0a68a2f2db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c30c53-b329-407e-bbe9-a0a68a2f2db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5236bb-eda6-4a45-b37e-d408b9c8a567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5236bb-eda6-4a45-b37e-d408b9c8a567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cf8ec0c-7303-4308-9d1c-dcda90f6e698', 'volume_name': 'volume-7cf8ec0c-7303-4308-9d1c-dcda90f6e698', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36df9406-ac15-4a1b-b608-032ba117322d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36df9406-ac15-4a1b-b608-032ba117322d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1911c1e-eed6-45c4-bab2-e3abdcdd3033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:56 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Volume 7cf8ec0c-7303-4308-9d1c-dcda90f6e698: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cf8ec0c-7303-4308-9d1c-dcda90f6e698', 'volume_size': 1} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:56 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f434f5d2-d674-43ab-b700-2d1a3f55d181 tempest-VolumeDependencyTests-1010503134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.500150e2-3c27-4dc9-84c6-95fdd290c02c" returned: 0 in 0.367s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f434f5d2-d674-43ab-b700-2d1a3f55d181 tempest-VolumeDependencyTests-1010503134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.500150e2-3c27-4dc9-84c6-95fdd290c02c {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:56 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.500150e2-3c27-4dc9-84c6-95fdd290c02c Sep 07 14:04:56 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:56 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f3b54eaa-640b-4ab0-a6e4-d24b5c96d9cd tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.info" returned: 0 in 0.287s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f3b54eaa-640b-4ab0-a6e4-d24b5c96d9cd tempest-ProjectReaderTests-2123950541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.178s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.207s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-761939170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e4ad2d9-cc15-4b99-b713-98e1134deb90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8fd9674bb249b899d5c69373880941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:53Z,use_quota=True,user_id='30c462f1a0094053b9f39392ba6e3442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Creating volume 1e4ad2d9-cc15-4b99-b713-98e1134deb90 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:56 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:56 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90 1073741824 Sep 07 14:04:56 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:56 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-f3b54eaa-640b-4ab0-a6e4-d24b5c96d9cd tempest-ProjectReaderTests-2123950541 None] Create snapshot completed successfully Sep 07 14:04:56 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f434f5d2-d674-43ab-b700-2d1a3f55d181 tempest-VolumeDependencyTests-1010503134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc.500150e2-3c27-4dc9-84c6-95fdd290c02c" returned: 0 in 0.258s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f434f5d2-d674-43ab-b700-2d1a3f55d181 tempest-VolumeDependencyTests-1010503134 None] Lock "cinder-quobyte-500150e2-3c27-4dc9-84c6-95fdd290c02c" released by "_delete_snapshot" :: held 1.774s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f434f5d2-d674-43ab-b700-2d1a3f55d181 tempest-VolumeDependencyTests-1010503134 None] Lock "cinder-quobyte-133e3509-862e-48a6-94cc-6b47084717fc" released by "delete_snapshot" :: held 1.805s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-f434f5d2-d674-43ab-b700-2d1a3f55d181 tempest-VolumeDependencyTests-1010503134 None] Created reservations ['a1d16cee-6cf5-4ed7-8194-e65524d70878', 'ce3ece38-4eeb-4bca-81ab-721e1a00a777', 'e654309e-8f96-471f-b859-13bc55aca73d', 'db1bd12d-0ac7-4191-86b4-6d4e8b606e29'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:57 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-f434f5d2-d674-43ab-b700-2d1a3f55d181 tempest-VolumeDependencyTests-1010503134 None] Delete snapshot completed successfully. Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f434f5d2-d674-43ab-b700-2d1a3f55d181 tempest-VolumeDependencyTests-1010503134 None] Lock "cinder-500150e2-3c27-4dc9-84c6-95fdd290c02c-delete_snapshot" released by "delete_snapshot" :: held 1.944s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:57 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90 1073741824" returned: 0 in 0.460s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:57 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90 Sep 07 14:04:57 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a88b60c4-3d85-4c4a-9f68-70137807bf57 tempest-VolumeDependencyTests-1010503134 None] Acquiring lock "cinder-133e3509-862e-48a6-94cc-6b47084717fc-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a88b60c4-3d85-4c4a-9f68-70137807bf57 tempest-VolumeDependencyTests-1010503134 None] Lock "cinder-133e3509-862e-48a6-94cc-6b47084717fc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a88b60c4-3d85-4c4a-9f68-70137807bf57 tempest-VolumeDependencyTests-1010503134 None] Acquiring lock "cinder-quobyte-133e3509-862e-48a6-94cc-6b47084717fc" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a88b60c4-3d85-4c4a-9f68-70137807bf57 tempest-VolumeDependencyTests-1010503134 None] Lock "cinder-quobyte-133e3509-862e-48a6-94cc-6b47084717fc" acquired by "delete_volume" :: waited 0.016s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[88440ed5-24b3-4b9a-b4ff-6c44a25e6641]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a88b60c4-3d85-4c4a-9f68-70137807bf57 tempest-VolumeDependencyTests-1010503134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:57 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc Sep 07 14:04:57 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:57 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90" returned: 0 in 0.288s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.927s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1849552107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cf8ec0c-7303-4308-9d1c-dcda90f6e698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd80b19127894f05b2b6f5083736d0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:57Z,use_quota=True,user_id='36f25a4a1cef480d9fbafc336f2af6b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Creating volume 7cf8ec0c-7303-4308-9d1c-dcda90f6e698 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:57 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7cf8ec0c-7303-4308-9d1c-dcda90f6e698 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:57 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7cf8ec0c-7303-4308-9d1c-dcda90f6e698 1073741824 Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4615870-75e1-46a4-a491-84f9f5829aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:57 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90b5c34-2160-4946-855a-4b3a11196e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:57 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Volume volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90 (1e4ad2d9-cc15-4b99-b713-98e1134deb90): created successfully Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90b5c34-2160-4946-855a-4b3a11196e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Flow 'volume_create_manager' (d926670d-f9ef-4e28-8d09-caf69a6f9a2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:57 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-ce572474-cddd-4e2a-a992-438502c6f4fc tempest-ProjectMemberTests-1858363890 None] Created volume successfully. Sep 07 14:04:57 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a88b60c4-3d85-4c4a-9f68-70137807bf57 tempest-VolumeDependencyTests-1010503134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc" returned: 0 in 0.405s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a88b60c4-3d85-4c4a-9f68-70137807bf57 tempest-VolumeDependencyTests-1010503134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:57 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc Sep 07 14:04:57 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7c7233db-c5b8-4106-bcfa-a5cf469922b0 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-36d9d29f-12f4-42c4-936e-a87a4a8fd981-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7c7233db-c5b8-4106-bcfa-a5cf469922b0 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-36d9d29f-12f4-42c4-936e-a87a4a8fd981-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7c7233db-c5b8-4106-bcfa-a5cf469922b0 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-quobyte-84f9c878-6df5-417e-a627-75ddb68cc203" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7c7233db-c5b8-4106-bcfa-a5cf469922b0 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-84f9c878-6df5-417e-a627-75ddb68cc203" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7c7233db-c5b8-4106-bcfa-a5cf469922b0 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-quobyte-36d9d29f-12f4-42c4-936e-a87a4a8fd981" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7c7233db-c5b8-4106-bcfa-a5cf469922b0 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-36d9d29f-12f4-42c4-936e-a87a4a8fd981" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-7c7233db-c5b8-4106-bcfa-a5cf469922b0 tempest-ProjectReaderTests-2123950541 None] Deleting offline snapshot 36d9d29f-12f4-42c4-936e-a87a4a8fd981 of volume 84f9c878-6df5-417e-a627-75ddb68cc203 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:04:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-7c7233db-c5b8-4106-bcfa-a5cf469922b0 tempest-ProjectReaderTests-2123950541 None] snapshot_file for this snap is: volume-84f9c878-6df5-417e-a627-75ddb68cc203.36d9d29f-12f4-42c4-936e-a87a4a8fd981 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[049390c3-ecd0-4e08-9786-2a4569d89110]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7c7233db-c5b8-4106-bcfa-a5cf469922b0 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.36d9d29f-12f4-42c4-936e-a87a4a8fd981 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:58 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7cf8ec0c-7303-4308-9d1c-dcda90f6e698 1073741824" returned: 0 in 0.514s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:58 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.36d9d29f-12f4-42c4-936e-a87a4a8fd981 Sep 07 14:04:58 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7cf8ec0c-7303-4308-9d1c-dcda90f6e698 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:58 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a88b60c4-3d85-4c4a-9f68-70137807bf57 tempest-VolumeDependencyTests-1010503134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-133e3509-862e-48a6-94cc-6b47084717fc" returned: 0 in 0.316s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a88b60c4-3d85-4c4a-9f68-70137807bf57 tempest-VolumeDependencyTests-1010503134 None] Lock "cinder-quobyte-133e3509-862e-48a6-94cc-6b47084717fc" released by "delete_volume" :: held 0.787s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:58 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7cf8ec0c-7303-4308-9d1c-dcda90f6e698 Sep 07 14:04:58 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-a88b60c4-3d85-4c4a-9f68-70137807bf57 tempest-VolumeDependencyTests-1010503134 None] Created reservations ['a638950a-fb15-4417-975a-5a7f2bd2625e', '101d85a2-05bc-4755-a994-361739120b9e', '4d2cb23d-df56-434a-814f-ebf79c7f6b23', '6149e220-3366-43b0-9185-c60e245ff7a7'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a88b60c4-3d85-4c4a-9f68-70137807bf57 tempest-VolumeDependencyTests-1010503134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a88b60c4-3d85-4c4a-9f68-70137807bf57 tempest-VolumeDependencyTests-1010503134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a88b60c4-3d85-4c4a-9f68-70137807bf57 tempest-VolumeDependencyTests-1010503134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a88b60c4-3d85-4c4a-9f68-70137807bf57 tempest-VolumeDependencyTests-1010503134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a88b60c4-3d85-4c4a-9f68-70137807bf57 tempest-VolumeDependencyTests-1010503134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a88b60c4-3d85-4c4a-9f68-70137807bf57 tempest-VolumeDependencyTests-1010503134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:58 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:58 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:58 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7c7233db-c5b8-4106-bcfa-a5cf469922b0 tempest-ProjectReaderTests-2123950541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.36d9d29f-12f4-42c4-936e-a87a4a8fd981" returned: 0 in 0.409s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-7c7233db-c5b8-4106-bcfa-a5cf469922b0 tempest-ProjectReaderTests-2123950541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84f9c878-6df5-417e-a627-75ddb68cc203(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab6da2b-f148-463d-9613-2ca203bab5b9]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7c7233db-c5b8-4106-bcfa-a5cf469922b0 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:58 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7cf8ec0c-7303-4308-9d1c-dcda90f6e698" returned: 0 in 0.306s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=228,cinder:UPDATE=351,cinder:DELETE=36,cinder:INSERT=101 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1911c1e-eed6-45c4-bab2-e3abdcdd3033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cf8ec0c-7303-4308-9d1c-dcda90f6e698', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38749ef1-aa8c-4475-9cf2-7ea16a2f4644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:58 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Volume volume-7cf8ec0c-7303-4308-9d1c-dcda90f6e698 (7cf8ec0c-7303-4308-9d1c-dcda90f6e698): created successfully Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38749ef1-aa8c-4475-9cf2-7ea16a2f4644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Flow 'volume_create_manager' (98186898-af81-48b3-9a23-e1e6a407ff31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8f7d7e22-2ebf-490e-9a98-d14c91f82bdb tempest-VolumeDependencyTests-1010503134 None] Acquiring lock "cinder-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:58 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-58c2fc16-8bee-4324-996c-8a9c25af1893 tempest-ProjectReaderTests-841007551 None] Created volume successfully. Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8f7d7e22-2ebf-490e-9a98-d14c91f82bdb tempest-VolumeDependencyTests-1010503134 None] Lock "cinder-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8f7d7e22-2ebf-490e-9a98-d14c91f82bdb tempest-VolumeDependencyTests-1010503134 None] Acquiring lock "cinder-quobyte-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:58 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203 Sep 07 14:04:58 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8f7d7e22-2ebf-490e-9a98-d14c91f82bdb tempest-VolumeDependencyTests-1010503134 None] Lock "cinder-quobyte-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f" acquired by "delete_volume" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:58 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a88b60c4-3d85-4c4a-9f68-70137807bf57 tempest-VolumeDependencyTests-1010503134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.327s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-a88b60c4-3d85-4c4a-9f68-70137807bf57 tempest-VolumeDependencyTests-1010503134 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:58 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-a88b60c4-3d85-4c4a-9f68-70137807bf57 tempest-VolumeDependencyTests-1010503134 None] Deleted volume successfully. Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=270,cinder:INSERT=78,cinder:UPDATE=325,cinder:DELETE=26 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ad4421-5566-4e22-aab8-d132d57ea05e]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8f7d7e22-2ebf-490e-9a98-d14c91f82bdb tempest-VolumeDependencyTests-1010503134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a88b60c4-3d85-4c4a-9f68-70137807bf57 tempest-VolumeDependencyTests-1010503134 None] Lock "cinder-133e3509-862e-48a6-94cc-6b47084717fc-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-28b65e06-5d38-4923-b113-c9a1583295e5 tempest-ProjectReaderTests-841007551 None] Acquiring lock "cinder-7cf8ec0c-7303-4308-9d1c-dcda90f6e698-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-28b65e06-5d38-4923-b113-c9a1583295e5 tempest-ProjectReaderTests-841007551 None] Lock "cinder-7cf8ec0c-7303-4308-9d1c-dcda90f6e698-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:58 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f Sep 07 14:04:58 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-28b65e06-5d38-4923-b113-c9a1583295e5 tempest-ProjectReaderTests-841007551 None] Acquiring lock "cinder-quobyte-7cf8ec0c-7303-4308-9d1c-dcda90f6e698" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-28b65e06-5d38-4923-b113-c9a1583295e5 tempest-ProjectReaderTests-841007551 None] Lock "cinder-quobyte-7cf8ec0c-7303-4308-9d1c-dcda90f6e698" acquired by "delete_volume" :: waited 0.028s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8114c7e4-e15a-4d54-a05a-c78064329645]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:58 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-28b65e06-5d38-4923-b113-c9a1583295e5 tempest-ProjectReaderTests-841007551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7cf8ec0c-7303-4308-9d1c-dcda90f6e698 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:59 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7c7233db-c5b8-4106-bcfa-a5cf469922b0 tempest-ProjectReaderTests-2123950541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203" returned: 0 in 0.597s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7c7233db-c5b8-4106-bcfa-a5cf469922b0 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.36d9d29f-12f4-42c4-936e-a87a4a8fd981 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:59 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.36d9d29f-12f4-42c4-936e-a87a4a8fd981 Sep 07 14:04:59 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:59 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7cf8ec0c-7303-4308-9d1c-dcda90f6e698 Sep 07 14:04:59 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-dee295c0-3be2-4d25-b5d2-7acdbd7082b6 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-dee295c0-3be2-4d25-b5d2-7acdbd7082b6 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-dee295c0-3be2-4d25-b5d2-7acdbd7082b6 tempest-ProjectMemberTests-1858363890 None] Creating offline snapshot f1d43c4d-83ae-459f-9936-96acc73c6608 of volume 1e4ad2d9-cc15-4b99-b713-98e1134deb90 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8018dd-6902-4c18-95f1-5e90149eccc5]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dee295c0-3be2-4d25-b5d2-7acdbd7082b6 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:59 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8f7d7e22-2ebf-490e-9a98-d14c91f82bdb tempest-VolumeDependencyTests-1010503134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f" returned: 0 in 0.595s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8f7d7e22-2ebf-490e-9a98-d14c91f82bdb tempest-VolumeDependencyTests-1010503134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:59 devstack sudo[108256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f Sep 07 14:04:59 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:59 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90 Sep 07 14:04:59 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:59 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-28b65e06-5d38-4923-b113-c9a1583295e5 tempest-ProjectReaderTests-841007551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7cf8ec0c-7303-4308-9d1c-dcda90f6e698" returned: 0 in 0.519s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-28b65e06-5d38-4923-b113-c9a1583295e5 tempest-ProjectReaderTests-841007551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7cf8ec0c-7303-4308-9d1c-dcda90f6e698 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:59 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7c7233db-c5b8-4106-bcfa-a5cf469922b0 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.36d9d29f-12f4-42c4-936e-a87a4a8fd981" returned: 0 in 0.444s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7c7233db-c5b8-4106-bcfa-a5cf469922b0 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.36d9d29f-12f4-42c4-936e-a87a4a8fd981 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:59 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7cf8ec0c-7303-4308-9d1c-dcda90f6e698 Sep 07 14:04:59 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:59 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.36d9d29f-12f4-42c4-936e-a87a4a8fd981 Sep 07 14:04:59 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:59 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8f7d7e22-2ebf-490e-9a98-d14c91f82bdb tempest-VolumeDependencyTests-1010503134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f" returned: 0 in 0.300s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8f7d7e22-2ebf-490e-9a98-d14c91f82bdb tempest-VolumeDependencyTests-1010503134 None] Lock "cinder-quobyte-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f" released by "delete_volume" :: held 0.970s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-8f7d7e22-2ebf-490e-9a98-d14c91f82bdb tempest-VolumeDependencyTests-1010503134 None] Created reservations ['045c840c-45f7-4362-a97a-3364a22e9eac', '4fbe6cd0-6065-4985-af86-4ceda2154a80', 'e49f5f3a-d3b1-48b1-ba2d-d24bb5083df5', '9f06efcf-9f6b-4a3f-a460-a1b1dea5fdf0'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:59 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dee295c0-3be2-4d25-b5d2-7acdbd7082b6 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90" returned: 0 in 0.469s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dee295c0-3be2-4d25-b5d2-7acdbd7082b6 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.f1d43c4d-83ae-459f-9936-96acc73c6608 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:59 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.f1d43c4d-83ae-459f-9936-96acc73c6608 1G Sep 07 14:04:59 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:59 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-28b65e06-5d38-4923-b113-c9a1583295e5 tempest-ProjectReaderTests-841007551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7cf8ec0c-7303-4308-9d1c-dcda90f6e698" returned: 0 in 0.327s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:59 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7c7233db-c5b8-4106-bcfa-a5cf469922b0 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203.36d9d29f-12f4-42c4-936e-a87a4a8fd981" returned: 0 in 0.321s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-28b65e06-5d38-4923-b113-c9a1583295e5 tempest-ProjectReaderTests-841007551 None] Lock "cinder-quobyte-7cf8ec0c-7303-4308-9d1c-dcda90f6e698" released by "delete_volume" :: held 0.928s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7c7233db-c5b8-4106-bcfa-a5cf469922b0 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-36d9d29f-12f4-42c4-936e-a87a4a8fd981" released by "_delete_snapshot" :: held 1.902s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8f7d7e22-2ebf-490e-9a98-d14c91f82bdb tempest-VolumeDependencyTests-1010503134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8f7d7e22-2ebf-490e-9a98-d14c91f82bdb tempest-VolumeDependencyTests-1010503134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8f7d7e22-2ebf-490e-9a98-d14c91f82bdb tempest-VolumeDependencyTests-1010503134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8f7d7e22-2ebf-490e-9a98-d14c91f82bdb tempest-VolumeDependencyTests-1010503134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8f7d7e22-2ebf-490e-9a98-d14c91f82bdb tempest-VolumeDependencyTests-1010503134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8f7d7e22-2ebf-490e-9a98-d14c91f82bdb tempest-VolumeDependencyTests-1010503134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7c7233db-c5b8-4106-bcfa-a5cf469922b0 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-84f9c878-6df5-417e-a627-75ddb68cc203" released by "delete_snapshot" :: held 1.950s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:59 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:04:59 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:59 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-28b65e06-5d38-4923-b113-c9a1583295e5 tempest-ProjectReaderTests-841007551 None] Created reservations ['e23786a7-e351-4f0d-a5ab-45cccfa33303', 'c1eab72c-67f4-41f4-b4eb-53c7731d08f4', 'd33ee346-9bde-454b-8ea5-3a7fd4e93dff', 'ad63addc-daa9-46f1-84c9-44bbe61fd288'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-7c7233db-c5b8-4106-bcfa-a5cf469922b0 tempest-ProjectReaderTests-2123950541 None] Created reservations ['cb0be1e0-6ee0-4072-b321-f83ab76ff879', 'bf9e8332-2c1d-4e32-b1f8-6eb89eec6171', '00824808-f91d-4e09-80dd-d936bee26473', 'ae04bbdf-3f60-4c3e-b985-d7595e70b44a'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-28b65e06-5d38-4923-b113-c9a1583295e5 tempest-ProjectReaderTests-841007551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-28b65e06-5d38-4923-b113-c9a1583295e5 tempest-ProjectReaderTests-841007551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-28b65e06-5d38-4923-b113-c9a1583295e5 tempest-ProjectReaderTests-841007551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-28b65e06-5d38-4923-b113-c9a1583295e5 tempest-ProjectReaderTests-841007551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-28b65e06-5d38-4923-b113-c9a1583295e5 tempest-ProjectReaderTests-841007551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-28b65e06-5d38-4923-b113-c9a1583295e5 tempest-ProjectReaderTests-841007551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:00 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:05:00 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ba5096d4-65a5-4021-8624-cfacc6bc4a5c tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-84f9c878-6df5-417e-a627-75ddb68cc203-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:00 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8f7d7e22-2ebf-490e-9a98-d14c91f82bdb tempest-VolumeDependencyTests-1010503134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.293s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-8f7d7e22-2ebf-490e-9a98-d14c91f82bdb tempest-VolumeDependencyTests-1010503134 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ba5096d4-65a5-4021-8624-cfacc6bc4a5c tempest-ProjectReaderTests-2123950541 None] Lock "cinder-84f9c878-6df5-417e-a627-75ddb68cc203-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:00 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-7c7233db-c5b8-4106-bcfa-a5cf469922b0 tempest-ProjectReaderTests-2123950541 None] Delete snapshot completed successfully. Sep 07 14:05:00 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-8f7d7e22-2ebf-490e-9a98-d14c91f82bdb tempest-VolumeDependencyTests-1010503134 None] Deleted volume successfully. Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7c7233db-c5b8-4106-bcfa-a5cf469922b0 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-36d9d29f-12f4-42c4-936e-a87a4a8fd981-delete_snapshot" released by "delete_snapshot" :: held 2.298s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-8f7d7e22-2ebf-490e-9a98-d14c91f82bdb tempest-VolumeDependencyTests-1010503134 None] Lock "cinder-bbd2c712-33e0-4c9e-92bf-dee007a7bc5f-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ba5096d4-65a5-4021-8624-cfacc6bc4a5c tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-quobyte-84f9c878-6df5-417e-a627-75ddb68cc203" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ba5096d4-65a5-4021-8624-cfacc6bc4a5c tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-84f9c878-6df5-417e-a627-75ddb68cc203" acquired by "delete_volume" :: waited 0.025s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[002365c7-da6b-413f-872a-49894ade0a8a]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ba5096d4-65a5-4021-8624-cfacc6bc4a5c tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:00 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dee295c0-3be2-4d25-b5d2-7acdbd7082b6 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.f1d43c4d-83ae-459f-9936-96acc73c6608 1G" returned: 0 in 0.620s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dee295c0-3be2-4d25-b5d2-7acdbd7082b6 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.f1d43c4d-83ae-459f-9936-96acc73c6608 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:00 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.f1d43c4d-83ae-459f-9936-96acc73c6608 Sep 07 14:05:00 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:00 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-28b65e06-5d38-4923-b113-c9a1583295e5 tempest-ProjectReaderTests-841007551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.338s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-28b65e06-5d38-4923-b113-c9a1583295e5 tempest-ProjectReaderTests-841007551 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:00 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-28b65e06-5d38-4923-b113-c9a1583295e5 tempest-ProjectReaderTests-841007551 None] Deleted volume successfully. Sep 07 14:05:00 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203 Sep 07 14:05:00 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-28b65e06-5d38-4923-b113-c9a1583295e5 tempest-ProjectReaderTests-841007551 None] Lock "cinder-7cf8ec0c-7303-4308-9d1c-dcda90f6e698-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:00 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dee295c0-3be2-4d25-b5d2-7acdbd7082b6 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.f1d43c4d-83ae-459f-9936-96acc73c6608" returned: 0 in 0.345s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:00 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-dee295c0-3be2-4d25-b5d2-7acdbd7082b6 tempest-ProjectMemberTests-1858363890 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.f1d43c4d-83ae-459f-9936-96acc73c6608 is being set with open permissions: ugo+rw Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dee295c0-3be2-4d25-b5d2-7acdbd7082b6 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.f1d43c4d-83ae-459f-9936-96acc73c6608 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:00 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.f1d43c4d-83ae-459f-9936-96acc73c6608 Sep 07 14:05:00 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:00 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ba5096d4-65a5-4021-8624-cfacc6bc4a5c tempest-ProjectReaderTests-2123950541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203" returned: 0 in 0.435s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ba5096d4-65a5-4021-8624-cfacc6bc4a5c tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:00 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203 Sep 07 14:05:00 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:00 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:00 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dee295c0-3be2-4d25-b5d2-7acdbd7082b6 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.f1d43c4d-83ae-459f-9936-96acc73c6608" returned: 0 in 0.280s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dee295c0-3be2-4d25-b5d2-7acdbd7082b6 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:01 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.info Sep 07 14:05:01 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:01 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ba5096d4-65a5-4021-8624-cfacc6bc4a5c tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-84f9c878-6df5-417e-a627-75ddb68cc203" returned: 0 in 0.323s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:01 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ba5096d4-65a5-4021-8624-cfacc6bc4a5c tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-84f9c878-6df5-417e-a627-75ddb68cc203" released by "delete_volume" :: held 0.833s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:01 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-ba5096d4-65a5-4021-8624-cfacc6bc4a5c tempest-ProjectReaderTests-2123950541 None] Created reservations ['8b80c70f-e93e-4bc5-ba6a-5da84e0c154f', '4d4c983e-6690-440f-aed6-100dc1269a07', '6f949bf1-d9de-406c-a2a3-c359dac1991d', '1adf8e68-9a41-48e9-9e6f-fd922dd436cd'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ba5096d4-65a5-4021-8624-cfacc6bc4a5c tempest-ProjectReaderTests-2123950541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ba5096d4-65a5-4021-8624-cfacc6bc4a5c tempest-ProjectReaderTests-2123950541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ba5096d4-65a5-4021-8624-cfacc6bc4a5c tempest-ProjectReaderTests-2123950541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:01 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:01 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ba5096d4-65a5-4021-8624-cfacc6bc4a5c tempest-ProjectReaderTests-2123950541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ba5096d4-65a5-4021-8624-cfacc6bc4a5c tempest-ProjectReaderTests-2123950541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ba5096d4-65a5-4021-8624-cfacc6bc4a5c tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dee295c0-3be2-4d25-b5d2-7acdbd7082b6 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.info" returned: 0 in 0.401s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:01 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-dee295c0-3be2-4d25-b5d2-7acdbd7082b6 tempest-ProjectMemberTests-1858363890 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.info is being set with open permissions: ugo+rw Sep 07 14:05:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dee295c0-3be2-4d25-b5d2-7acdbd7082b6 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:01 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:05:01 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:01 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.info Sep 07 14:05:01 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:01 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:01 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dee295c0-3be2-4d25-b5d2-7acdbd7082b6 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.info" returned: 0 in 0.333s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-dee295c0-3be2-4d25-b5d2-7acdbd7082b6 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.574s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:01 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ba5096d4-65a5-4021-8624-cfacc6bc4a5c tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.382s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:01 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-ba5096d4-65a5-4021-8624-cfacc6bc4a5c tempest-ProjectReaderTests-2123950541 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:01 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-ba5096d4-65a5-4021-8624-cfacc6bc4a5c tempest-ProjectReaderTests-2123950541 None] Deleted volume successfully. Sep 07 14:05:01 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ba5096d4-65a5-4021-8624-cfacc6bc4a5c tempest-ProjectReaderTests-2123950541 None] Lock "cinder-84f9c878-6df5-417e-a627-75ddb68cc203-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:01 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-dee295c0-3be2-4d25-b5d2-7acdbd7082b6 tempest-ProjectMemberTests-1858363890 None] Create snapshot completed successfully Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Flow 'volume_create_manager' (0c6ff637-81d3-4d7f-b193-225ec1662f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c283df00-55f5-45bf-aad2-7a21329f32ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c283df00-55f5-45bf-aad2-7a21329f32ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1010946479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6865c1c9-03f6-4364-9ba0-216a3ec345a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f88686a757b48d2ac1a60b2911cabe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:02Z,use_quota=True,user_id='28a72580cb7e409aa7c0843102d083c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836e8a65-90d3-4e8f-99b3-10cb18be1b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836e8a65-90d3-4e8f-99b3-10cb18be1b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f87244-f245-4ced-a788-aa539b601c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f87244-f245-4ced-a788-aa539b601c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6865c1c9-03f6-4364-9ba0-216a3ec345a7', 'volume_name': 'volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7786d53-d9c3-4ec8-b535-f2a8a6d59d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7786d53-d9c3-4ec8-b535-f2a8a6d59d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff5a233-2fc3-40da-84b6-916e30279b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:02 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Volume 6865c1c9-03f6-4364-9ba0-216a3ec345a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7', 'volume_size': 1} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1010946479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6865c1c9-03f6-4364-9ba0-216a3ec345a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f88686a757b48d2ac1a60b2911cabe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:02Z,use_quota=True,user_id='28a72580cb7e409aa7c0843102d083c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Creating volume 6865c1c9-03f6-4364-9ba0-216a3ec345a7 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:02 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:02 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7 1073741824 Sep 07 14:05:02 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-df1f62e7-8d19-475d-ae3c-f450c4772bb5 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-f1d43c4d-83ae-459f-9936-96acc73c6608-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-df1f62e7-8d19-475d-ae3c-f450c4772bb5 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-f1d43c4d-83ae-459f-9936-96acc73c6608-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-df1f62e7-8d19-475d-ae3c-f450c4772bb5 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-1e4ad2d9-cc15-4b99-b713-98e1134deb90" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-df1f62e7-8d19-475d-ae3c-f450c4772bb5 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-1e4ad2d9-cc15-4b99-b713-98e1134deb90" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-df1f62e7-8d19-475d-ae3c-f450c4772bb5 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-f1d43c4d-83ae-459f-9936-96acc73c6608" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-df1f62e7-8d19-475d-ae3c-f450c4772bb5 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-f1d43c4d-83ae-459f-9936-96acc73c6608" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-df1f62e7-8d19-475d-ae3c-f450c4772bb5 tempest-ProjectMemberTests-1858363890 None] Deleting offline snapshot f1d43c4d-83ae-459f-9936-96acc73c6608 of volume 1e4ad2d9-cc15-4b99-b713-98e1134deb90 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-df1f62e7-8d19-475d-ae3c-f450c4772bb5 tempest-ProjectMemberTests-1858363890 None] snapshot_file for this snap is: volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.f1d43c4d-83ae-459f-9936-96acc73c6608 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04850c3-2325-463c-8a47-6b5152da2235]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-df1f62e7-8d19-475d-ae3c-f450c4772bb5 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.f1d43c4d-83ae-459f-9936-96acc73c6608 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:02 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.f1d43c4d-83ae-459f-9936-96acc73c6608 Sep 07 14:05:02 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:02 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7 1073741824" returned: 0 in 0.585s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:02 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:02 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7 Sep 07 14:05:02 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:03 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-df1f62e7-8d19-475d-ae3c-f450c4772bb5 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.f1d43c4d-83ae-459f-9936-96acc73c6608" returned: 0 in 0.495s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:03 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-df1f62e7-8d19-475d-ae3c-f450c4772bb5 tempest-ProjectMemberTests-1858363890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:05:03 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22386c2-3795-4797-abdc-7c05c3d6ff67]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-df1f62e7-8d19-475d-ae3c-f450c4772bb5 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:03 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7" returned: 0 in 0.398s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:03 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff5a233-2fc3-40da-84b6-916e30279b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef47607-4c1b-490a-9fad-8a76fb5f8856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:03 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Volume volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7 (6865c1c9-03f6-4364-9ba0-216a3ec345a7): created successfully Sep 07 14:05:03 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90 Sep 07 14:05:03 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef47607-4c1b-490a-9fad-8a76fb5f8856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:03 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Flow 'volume_create_manager' (0c6ff637-81d3-4d7f-b193-225ec1662f31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:03 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-b07481d6-aaab-4311-8b70-864b08206e75 tempest-ProjectReaderTests-2123950541 None] Created volume successfully. Sep 07 14:05:03 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-df1f62e7-8d19-475d-ae3c-f450c4772bb5 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90" returned: 0 in 0.491s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:03 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-df1f62e7-8d19-475d-ae3c-f450c4772bb5 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.f1d43c4d-83ae-459f-9936-96acc73c6608 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:03 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.f1d43c4d-83ae-459f-9936-96acc73c6608 Sep 07 14:05:03 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:04 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-df1f62e7-8d19-475d-ae3c-f450c4772bb5 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.f1d43c4d-83ae-459f-9936-96acc73c6608" returned: 0 in 0.417s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-df1f62e7-8d19-475d-ae3c-f450c4772bb5 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.f1d43c4d-83ae-459f-9936-96acc73c6608 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:04 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.f1d43c4d-83ae-459f-9936-96acc73c6608 Sep 07 14:05:04 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:04 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-df1f62e7-8d19-475d-ae3c-f450c4772bb5 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90.f1d43c4d-83ae-459f-9936-96acc73c6608" returned: 0 in 0.346s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-df1f62e7-8d19-475d-ae3c-f450c4772bb5 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-f1d43c4d-83ae-459f-9936-96acc73c6608" released by "_delete_snapshot" :: held 1.878s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-df1f62e7-8d19-475d-ae3c-f450c4772bb5 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-1e4ad2d9-cc15-4b99-b713-98e1134deb90" released by "delete_snapshot" :: held 1.909s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0b3618aa-71c1-4752-a42b-5c6da0d08537 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0b3618aa-71c1-4752-a42b-5c6da0d08537 tempest-ProjectReaderTests-2123950541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:04 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-0b3618aa-71c1-4752-a42b-5c6da0d08537 tempest-ProjectReaderTests-2123950541 None] Creating offline snapshot 7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb of volume 6865c1c9-03f6-4364-9ba0-216a3ec345a7 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:05:04 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b178dcff-ef60-431a-b562-7066a0ad4df1]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0b3618aa-71c1-4752-a42b-5c6da0d08537 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:04 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-df1f62e7-8d19-475d-ae3c-f450c4772bb5 tempest-ProjectMemberTests-1858363890 None] Created reservations ['f58b5ce9-e772-4668-b102-6c76ae02ef16', '1a318a0d-f2dd-4854-95e9-f89c2b18a88a', '775d6365-83bf-486a-990c-4d2bfcd6b90f', '59207774-9d14-411c-a09d-af3aa78f384f'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:04 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-df1f62e7-8d19-475d-ae3c-f450c4772bb5 tempest-ProjectMemberTests-1858363890 None] Delete snapshot completed successfully. Sep 07 14:05:04 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-df1f62e7-8d19-475d-ae3c-f450c4772bb5 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-f1d43c4d-83ae-459f-9936-96acc73c6608-delete_snapshot" released by "delete_snapshot" :: held 2.138s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:04 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7 Sep 07 14:05:04 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:04 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0b3618aa-71c1-4752-a42b-5c6da0d08537 tempest-ProjectReaderTests-2123950541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7" returned: 0 in 0.413s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:04 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0b3618aa-71c1-4752-a42b-5c6da0d08537 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:05 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb 1G Sep 07 14:05:05 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Flow 'volume_create_manager' (205cbffd-c5bb-4b82-b2b5-8a944292170d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b76c1f2-dd54-47b3-941f-92b9dcd65eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b76c1f2-dd54-47b3-941f-92b9dcd65eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a408428d-c206-4fb3-a7ea-bd79971f8516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2523099edb0b4376a4c97c2d3ece20bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:05Z,use_quota=True,user_id='c6ef1ee6c4924fc296489097da924496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3443cb0a-81e7-4a7b-91c8-23649114bdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3443cb0a-81e7-4a7b-91c8-23649114bdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0a4a18-805d-415b-a724-3c559c9e77a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0a4a18-805d-415b-a724-3c559c9e77a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a408428d-c206-4fb3-a7ea-bd79971f8516', 'volume_name': 'volume-a408428d-c206-4fb3-a7ea-bd79971f8516', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (042144e0-18d8-4e84-aab7-9ae36a20a582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (042144e0-18d8-4e84-aab7-9ae36a20a582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d57618e-6741-4584-8265-677e067933f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:05 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Volume a408428d-c206-4fb3-a7ea-bd79971f8516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a408428d-c206-4fb3-a7ea-bd79971f8516', 'volume_size': 1} Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:05 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0b3618aa-71c1-4752-a42b-5c6da0d08537 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb 1G" returned: 0 in 0.391s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0b3618aa-71c1-4752-a42b-5c6da0d08537 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:05 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb Sep 07 14:05:05 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:05 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0b3618aa-71c1-4752-a42b-5c6da0d08537 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb" returned: 0 in 0.284s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:05 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-0b3618aa-71c1-4752-a42b-5c6da0d08537 tempest-ProjectReaderTests-2123950541 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb is being set with open permissions: ugo+rw Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0b3618aa-71c1-4752-a42b-5c6da0d08537 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:05 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb Sep 07 14:05:05 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a581d600-b552-4de3-8610-afd70ff32a93 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-1e4ad2d9-cc15-4b99-b713-98e1134deb90-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a581d600-b552-4de3-8610-afd70ff32a93 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-1e4ad2d9-cc15-4b99-b713-98e1134deb90-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a581d600-b552-4de3-8610-afd70ff32a93 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-1e4ad2d9-cc15-4b99-b713-98e1134deb90" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a581d600-b552-4de3-8610-afd70ff32a93 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-1e4ad2d9-cc15-4b99-b713-98e1134deb90" acquired by "delete_volume" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d5f32a-a1d4-47f2-a559-397e3c099448]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a581d600-b552-4de3-8610-afd70ff32a93 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:05 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0b3618aa-71c1-4752-a42b-5c6da0d08537 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb" returned: 0 in 0.284s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:05 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90 Sep 07 14:05:05 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:05 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0b3618aa-71c1-4752-a42b-5c6da0d08537 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:05 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.info Sep 07 14:05:05 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:06 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0b3618aa-71c1-4752-a42b-5c6da0d08537 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.info" returned: 0 in 0.252s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:06 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-0b3618aa-71c1-4752-a42b-5c6da0d08537 tempest-ProjectReaderTests-2123950541 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.info is being set with open permissions: ugo+rw Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0b3618aa-71c1-4752-a42b-5c6da0d08537 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:06 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a581d600-b552-4de3-8610-afd70ff32a93 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90" returned: 0 in 0.378s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a581d600-b552-4de3-8610-afd70ff32a93 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:06 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.info Sep 07 14:05:06 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:06 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90 Sep 07 14:05:06 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:06 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a581d600-b552-4de3-8610-afd70ff32a93 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-1e4ad2d9-cc15-4b99-b713-98e1134deb90" returned: 0 in 0.234s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:06 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0b3618aa-71c1-4752-a42b-5c6da0d08537 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.info" returned: 0 in 0.262s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-0b3618aa-71c1-4752-a42b-5c6da0d08537 tempest-ProjectReaderTests-2123950541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.980s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a581d600-b552-4de3-8610-afd70ff32a93 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-1e4ad2d9-cc15-4b99-b713-98e1134deb90" released by "delete_volume" :: held 0.688s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.327s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a408428d-c206-4fb3-a7ea-bd79971f8516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2523099edb0b4376a4c97c2d3ece20bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:05Z,use_quota=True,user_id='c6ef1ee6c4924fc296489097da924496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Creating volume a408428d-c206-4fb3-a7ea-bd79971f8516 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:06 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a408428d-c206-4fb3-a7ea-bd79971f8516 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:06 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a408428d-c206-4fb3-a7ea-bd79971f8516 1073741824 Sep 07 14:05:06 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:06 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-0b3618aa-71c1-4752-a42b-5c6da0d08537 tempest-ProjectReaderTests-2123950541 None] Create snapshot completed successfully Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-a581d600-b552-4de3-8610-afd70ff32a93 tempest-ProjectMemberTests-1858363890 None] Created reservations ['f20303a2-c8b9-4282-8e49-828fd586b225', 'd9d8dfd7-4004-4391-95cd-9ddf767b61c3', '47ea1560-cdc4-48be-aff7-8f63bdb6e67e', '9d1dd5e9-f654-44e4-bb68-ae51dc6d6a9b'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a581d600-b552-4de3-8610-afd70ff32a93 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a581d600-b552-4de3-8610-afd70ff32a93 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a581d600-b552-4de3-8610-afd70ff32a93 tempest-ProjectMemberTests-1858363890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a581d600-b552-4de3-8610-afd70ff32a93 tempest-ProjectMemberTests-1858363890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a581d600-b552-4de3-8610-afd70ff32a93 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a581d600-b552-4de3-8610-afd70ff32a93 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:06 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:05:06 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:06 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a581d600-b552-4de3-8610-afd70ff32a93 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.268s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-a581d600-b552-4de3-8610-afd70ff32a93 tempest-ProjectMemberTests-1858363890 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:06 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-a581d600-b552-4de3-8610-afd70ff32a93 tempest-ProjectMemberTests-1858363890 None] Deleted volume successfully. Sep 07 14:05:06 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a581d600-b552-4de3-8610-afd70ff32a93 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-1e4ad2d9-cc15-4b99-b713-98e1134deb90-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:07 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a408428d-c206-4fb3-a7ea-bd79971f8516 1073741824" returned: 0 in 0.511s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a408428d-c206-4fb3-a7ea-bd79971f8516 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:07 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a408428d-c206-4fb3-a7ea-bd79971f8516 Sep 07 14:05:07 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:07 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a408428d-c206-4fb3-a7ea-bd79971f8516" returned: 0 in 0.261s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d57618e-6741-4584-8265-677e067933f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a408428d-c206-4fb3-a7ea-bd79971f8516', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b55d8250-92bf-44f2-b62a-0cc28e13de82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:07 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Volume volume-a408428d-c206-4fb3-a7ea-bd79971f8516 (a408428d-c206-4fb3-a7ea-bd79971f8516): created successfully Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b55d8250-92bf-44f2-b62a-0cc28e13de82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Flow 'volume_create_manager' (205cbffd-c5bb-4b82-b2b5-8a944292170d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:07 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-ce3d3ddf-51a3-43f3-bd14-a8af77c6ca0a tempest-CinderUnicodeTest-718313513 None] Created volume successfully. Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Flow 'volume_create_manager' (ef3ee9ae-534b-4115-8ad6-7da07d9bd585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c40c7b3-db1e-4044-975f-c23439784916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c40c7b3-db1e-4044-975f-c23439784916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1344563792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8fd9674bb249b899d5c69373880941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:07Z,use_quota=True,user_id='30c462f1a0094053b9f39392ba6e3442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fa3c0f-26e6-4e38-a867-0522449b7537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fa3c0f-26e6-4e38-a867-0522449b7537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7783b938-ea95-4295-ba96-02a1dd6711bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7783b938-ea95-4295-ba96-02a1dd6711bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5', 'volume_name': 'volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdcd75ef-f141-49c3-9ccc-18aa2e24a9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdcd75ef-f141-49c3-9ccc-18aa2e24a9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9966a13-8209-4396-9e95-b2326ccf44dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:07 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Volume 93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5', 'volume_size': 1} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1344563792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8fd9674bb249b899d5c69373880941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:07Z,use_quota=True,user_id='30c462f1a0094053b9f39392ba6e3442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Creating volume 93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:07 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:07 devstack sudo[108391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5 1073741824 Sep 07 14:05:07 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0626a7e2-3d69-4cf4-a6ab-cbe6d3389bf7 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0626a7e2-3d69-4cf4-a6ab-cbe6d3389bf7 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0626a7e2-3d69-4cf4-a6ab-cbe6d3389bf7 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-quobyte-6865c1c9-03f6-4364-9ba0-216a3ec345a7" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0626a7e2-3d69-4cf4-a6ab-cbe6d3389bf7 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-6865c1c9-03f6-4364-9ba0-216a3ec345a7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0626a7e2-3d69-4cf4-a6ab-cbe6d3389bf7 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-quobyte-7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0626a7e2-3d69-4cf4-a6ab-cbe6d3389bf7 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-0626a7e2-3d69-4cf4-a6ab-cbe6d3389bf7 tempest-ProjectReaderTests-2123950541 None] Deleting offline snapshot 7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb of volume 6865c1c9-03f6-4364-9ba0-216a3ec345a7 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-0626a7e2-3d69-4cf4-a6ab-cbe6d3389bf7 tempest-ProjectReaderTests-2123950541 None] snapshot_file for this snap is: volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd39597-a36b-4f3c-95d7-296494e0167a]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0626a7e2-3d69-4cf4-a6ab-cbe6d3389bf7 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:07 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb Sep 07 14:05:07 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:07 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5 1073741824" returned: 0 in 0.408s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:07 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:08 devstack sudo[108400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5 Sep 07 14:05:08 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:08 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0626a7e2-3d69-4cf4-a6ab-cbe6d3389bf7 tempest-ProjectReaderTests-2123950541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb" returned: 0 in 0.367s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-0626a7e2-3d69-4cf4-a6ab-cbe6d3389bf7 tempest-ProjectReaderTests-2123950541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae4a218-3a8f-4bb4-a38d-4e1faa9ec61c]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0626a7e2-3d69-4cf4-a6ab-cbe6d3389bf7 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:08 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7 Sep 07 14:05:08 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:08 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5" returned: 0 in 0.273s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9966a13-8209-4396-9e95-b2326ccf44dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (586623ea-a254-4f65-8317-c994ee5dd427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:08 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Volume volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5 (93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5): created successfully Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (586623ea-a254-4f65-8317-c994ee5dd427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Flow 'volume_create_manager' (ef3ee9ae-534b-4115-8ad6-7da07d9bd585) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:08 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-5b83b77c-725f-408d-8fc2-7f890bd0443d tempest-ProjectMemberTests-1858363890 None] Created volume successfully. Sep 07 14:05:08 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0626a7e2-3d69-4cf4-a6ab-cbe6d3389bf7 tempest-ProjectReaderTests-2123950541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7" returned: 0 in 0.395s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0626a7e2-3d69-4cf4-a6ab-cbe6d3389bf7 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:08 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb Sep 07 14:05:08 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-72492e30-c189-4054-827c-ab8b1e55a816 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-72492e30-c189-4054-827c-ab8b1e55a816 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-72492e30-c189-4054-827c-ab8b1e55a816 tempest-ProjectMemberTests-1858363890 None] Creating offline snapshot 147f74fd-14e4-435c-81e5-54801b1c3d70 of volume 93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aad7eba-737d-4f8e-9750-bc5bb79781c6]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-72492e30-c189-4054-827c-ab8b1e55a816 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:08 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0626a7e2-3d69-4cf4-a6ab-cbe6d3389bf7 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb" returned: 0 in 0.390s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0626a7e2-3d69-4cf4-a6ab-cbe6d3389bf7 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:08 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb Sep 07 14:05:08 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:08 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5 Sep 07 14:05:08 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Flow 'volume_create_manager' (fd757999-efe0-4ed3-a535-4b4cd4905e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ace21d-b5ff-4b9b-bfa5-d2081a55fd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ace21d-b5ff-4b9b-bfa5-d2081a55fd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1733427458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac9f702-fb10-471b-81f7-2b78b6f12502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2523099edb0b4376a4c97c2d3ece20bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:09Z,use_quota=True,user_id='c6ef1ee6c4924fc296489097da924496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:08 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139c2a20-8db4-4821-a57e-f0487be5a329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139c2a20-8db4-4821-a57e-f0487be5a329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b0ef95-5e12-42e5-82bf-92db39b18475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b0ef95-5e12-42e5-82bf-92db39b18475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cac9f702-fb10-471b-81f7-2b78b6f12502', 'volume_name': 'volume-cac9f702-fb10-471b-81f7-2b78b6f12502', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07453061-1b84-42bc-8611-86a926b45917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07453061-1b84-42bc-8611-86a926b45917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f77bcd-4b79-4e5e-9928-59a5fb899478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:09 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Volume cac9f702-fb10-471b-81f7-2b78b6f12502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cac9f702-fb10-471b-81f7-2b78b6f12502', 'volume_size': 1} Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:09 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-0626a7e2-3d69-4cf4-a6ab-cbe6d3389bf7 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7.7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb" returned: 0 in 0.254s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0626a7e2-3d69-4cf4-a6ab-cbe6d3389bf7 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb" released by "_delete_snapshot" :: held 1.491s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:09 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-72492e30-c189-4054-827c-ab8b1e55a816 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5" returned: 0 in 0.388s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-72492e30-c189-4054-827c-ab8b1e55a816 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.147f74fd-14e4-435c-81e5-54801b1c3d70 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0626a7e2-3d69-4cf4-a6ab-cbe6d3389bf7 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-6865c1c9-03f6-4364-9ba0-216a3ec345a7" released by "delete_snapshot" :: held 1.525s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:09 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.147f74fd-14e4-435c-81e5-54801b1c3d70 1G Sep 07 14:05:09 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-0626a7e2-3d69-4cf4-a6ab-cbe6d3389bf7 tempest-ProjectReaderTests-2123950541 None] Created reservations ['e4946892-ad8c-42fa-b1a1-232f24530b6b', '5827c34d-2d5d-467b-9406-0cb10f7c743b', '1fc6314e-d46d-41cf-8db5-61372d11a08a', '4b8ab84d-b33b-40e9-84c4-9cf579b7ac5d'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:09 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-0626a7e2-3d69-4cf4-a6ab-cbe6d3389bf7 tempest-ProjectReaderTests-2123950541 None] Delete snapshot completed successfully. Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-0626a7e2-3d69-4cf4-a6ab-cbe6d3389bf7 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-7cc2c8e5-1ec0-4528-acb5-5b992c30eeeb-delete_snapshot" released by "delete_snapshot" :: held 1.675s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:09 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-72492e30-c189-4054-827c-ab8b1e55a816 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.147f74fd-14e4-435c-81e5-54801b1c3d70 1G" returned: 0 in 0.388s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-72492e30-c189-4054-827c-ab8b1e55a816 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.147f74fd-14e4-435c-81e5-54801b1c3d70 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:09 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.147f74fd-14e4-435c-81e5-54801b1c3d70 Sep 07 14:05:09 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-80ccaa11-247a-41cd-8608-992433b45f3f tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-6865c1c9-03f6-4364-9ba0-216a3ec345a7-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-80ccaa11-247a-41cd-8608-992433b45f3f tempest-ProjectReaderTests-2123950541 None] Lock "cinder-6865c1c9-03f6-4364-9ba0-216a3ec345a7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-80ccaa11-247a-41cd-8608-992433b45f3f tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-quobyte-6865c1c9-03f6-4364-9ba0-216a3ec345a7" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-80ccaa11-247a-41cd-8608-992433b45f3f tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-6865c1c9-03f6-4364-9ba0-216a3ec345a7" acquired by "delete_volume" :: waited 0.015s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:09 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-72492e30-c189-4054-827c-ab8b1e55a816 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.147f74fd-14e4-435c-81e5-54801b1c3d70" returned: 0 in 0.350s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:09 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-72492e30-c189-4054-827c-ab8b1e55a816 tempest-ProjectMemberTests-1858363890 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.147f74fd-14e4-435c-81e5-54801b1c3d70 is being set with open permissions: ugo+rw Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-72492e30-c189-4054-827c-ab8b1e55a816 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.147f74fd-14e4-435c-81e5-54801b1c3d70 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[381ffbad-b452-420c-8e63-41947baacd79]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:09 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-80ccaa11-247a-41cd-8608-992433b45f3f tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:09 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.147f74fd-14e4-435c-81e5-54801b1c3d70 Sep 07 14:05:09 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:10 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7 Sep 07 14:05:10 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:10 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-72492e30-c189-4054-827c-ab8b1e55a816 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.147f74fd-14e4-435c-81e5-54801b1c3d70" returned: 0 in 0.248s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-72492e30-c189-4054-827c-ab8b1e55a816 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:10 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.info Sep 07 14:05:10 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:10 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-80ccaa11-247a-41cd-8608-992433b45f3f tempest-ProjectReaderTests-2123950541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7" returned: 0 in 0.341s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-80ccaa11-247a-41cd-8608-992433b45f3f tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:10 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7 Sep 07 14:05:10 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:10 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-72492e30-c189-4054-827c-ab8b1e55a816 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.info" returned: 0 in 0.246s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:10 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-72492e30-c189-4054-827c-ab8b1e55a816 tempest-ProjectMemberTests-1858363890 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.info is being set with open permissions: ugo+rw Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-72492e30-c189-4054-827c-ab8b1e55a816 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:10 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.info Sep 07 14:05:10 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:10 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-80ccaa11-247a-41cd-8608-992433b45f3f tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-6865c1c9-03f6-4364-9ba0-216a3ec345a7" returned: 0 in 0.280s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-80ccaa11-247a-41cd-8608-992433b45f3f tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-6865c1c9-03f6-4364-9ba0-216a3ec345a7" released by "delete_volume" :: held 0.680s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-80ccaa11-247a-41cd-8608-992433b45f3f tempest-ProjectReaderTests-2123950541 None] Created reservations ['ef980bc2-8994-443a-9578-6f7aededc9da', '10e45fbf-9be2-4d41-bf7f-13b46d2f8e31', 'f3a70582-9623-44c4-9f4a-199cdd94ac4f', 'e871664d-5cae-4050-a0c7-6c02f32ac9d0'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-80ccaa11-247a-41cd-8608-992433b45f3f tempest-ProjectReaderTests-2123950541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-80ccaa11-247a-41cd-8608-992433b45f3f tempest-ProjectReaderTests-2123950541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-80ccaa11-247a-41cd-8608-992433b45f3f tempest-ProjectReaderTests-2123950541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:10 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-80ccaa11-247a-41cd-8608-992433b45f3f tempest-ProjectReaderTests-2123950541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-80ccaa11-247a-41cd-8608-992433b45f3f tempest-ProjectReaderTests-2123950541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-80ccaa11-247a-41cd-8608-992433b45f3f tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-72492e30-c189-4054-827c-ab8b1e55a816 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.info" returned: 0 in 0.260s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-72492e30-c189-4054-827c-ab8b1e55a816 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.717s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1733427458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac9f702-fb10-471b-81f7-2b78b6f12502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2523099edb0b4376a4c97c2d3ece20bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:09Z,use_quota=True,user_id='c6ef1ee6c4924fc296489097da924496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Creating volume cac9f702-fb10-471b-81f7-2b78b6f12502 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:10 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:10 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:10 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:10 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502 1073741824 Sep 07 14:05:10 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:10 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-72492e30-c189-4054-827c-ab8b1e55a816 tempest-ProjectMemberTests-1858363890 None] Create snapshot completed successfully Sep 07 14:05:10 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-80ccaa11-247a-41cd-8608-992433b45f3f tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.270s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:10 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-80ccaa11-247a-41cd-8608-992433b45f3f tempest-ProjectReaderTests-2123950541 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:10 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-80ccaa11-247a-41cd-8608-992433b45f3f tempest-ProjectReaderTests-2123950541 None] Deleted volume successfully. Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-80ccaa11-247a-41cd-8608-992433b45f3f tempest-ProjectReaderTests-2123950541 None] Lock "cinder-6865c1c9-03f6-4364-9ba0-216a3ec345a7-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:11 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502 1073741824" returned: 0 in 0.463s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:11 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502 Sep 07 14:05:11 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Flow 'volume_create_manager' (9e35d1c9-efbb-438b-be24-3b770a75d863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d09755-50b8-40d9-9193-f7687f475eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d09755-50b8-40d9-9193-f7687f475eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1898655952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc49251d-27c9-410e-893b-9943d2a5e7ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f88686a757b48d2ac1a60b2911cabe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:11Z,use_quota=True,user_id='28a72580cb7e409aa7c0843102d083c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5493c939-1095-43fe-90dd-95a93efed484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5493c939-1095-43fe-90dd-95a93efed484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e24f617-8fc2-4e19-bcf4-c6e5996fc649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:11 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e24f617-8fc2-4e19-bcf4-c6e5996fc649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc49251d-27c9-410e-893b-9943d2a5e7ed', 'volume_name': 'volume-fc49251d-27c9-410e-893b-9943d2a5e7ed', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0212d9f-f647-403b-9ba0-997bbc1ec922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0212d9f-f647-403b-9ba0-997bbc1ec922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a48890-d8b1-4110-be8f-3c9f07a850ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:11 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Volume fc49251d-27c9-410e-893b-9943d2a5e7ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc49251d-27c9-410e-893b-9943d2a5e7ed', 'volume_size': 1} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502" returned: 0 in 0.290s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1898655952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc49251d-27c9-410e-893b-9943d2a5e7ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f88686a757b48d2ac1a60b2911cabe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:11Z,use_quota=True,user_id='28a72580cb7e409aa7c0843102d083c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Creating volume fc49251d-27c9-410e-893b-9943d2a5e7ed {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:11 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:11 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed 1073741824 Sep 07 14:05:11 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f77bcd-4b79-4e5e-9928-59a5fb899478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cac9f702-fb10-471b-81f7-2b78b6f12502', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee58f278-8ed1-4fcb-a4e4-fba46415f785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:11 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Volume volume-cac9f702-fb10-471b-81f7-2b78b6f12502 (cac9f702-fb10-471b-81f7-2b78b6f12502): created successfully Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee58f278-8ed1-4fcb-a4e4-fba46415f785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Flow 'volume_create_manager' (fd757999-efe0-4ed3-a535-4b4cd4905e60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:11 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-a06947d0-32f7-43fa-b61d-7ba6b37be9b4 tempest-CinderUnicodeTest-718313513 None] Created volume successfully. Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7a697165-ae63-4c4c-b63a-ec99ad129517 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-147f74fd-14e4-435c-81e5-54801b1c3d70-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7a697165-ae63-4c4c-b63a-ec99ad129517 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-147f74fd-14e4-435c-81e5-54801b1c3d70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7a697165-ae63-4c4c-b63a-ec99ad129517 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7a697165-ae63-4c4c-b63a-ec99ad129517 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7a697165-ae63-4c4c-b63a-ec99ad129517 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-147f74fd-14e4-435c-81e5-54801b1c3d70" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7a697165-ae63-4c4c-b63a-ec99ad129517 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-147f74fd-14e4-435c-81e5-54801b1c3d70" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-7a697165-ae63-4c4c-b63a-ec99ad129517 tempest-ProjectMemberTests-1858363890 None] Deleting offline snapshot 147f74fd-14e4-435c-81e5-54801b1c3d70 of volume 93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-7a697165-ae63-4c4c-b63a-ec99ad129517 tempest-ProjectMemberTests-1858363890 None] snapshot_file for this snap is: volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.147f74fd-14e4-435c-81e5-54801b1c3d70 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[59165208-9c9f-4f41-a3d3-ba97a5790e17]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:11 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7a697165-ae63-4c4c-b63a-ec99ad129517 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.147f74fd-14e4-435c-81e5-54801b1c3d70 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:12 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed 1073741824" returned: 0 in 0.481s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:12 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.147f74fd-14e4-435c-81e5-54801b1c3d70 Sep 07 14:05:12 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:12 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed Sep 07 14:05:12 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5f2f7b9e-4bf5-4b93-85a2-442cbe950753 tempest-CinderUnicodeTest-718313513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:12 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7a697165-ae63-4c4c-b63a-ec99ad129517 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.147f74fd-14e4-435c-81e5-54801b1c3d70" returned: 0 in 0.401s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-7a697165-ae63-4c4c-b63a-ec99ad129517 tempest-ProjectMemberTests-1858363890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:05:12 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:12 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba658416-0488-4222-a619-fb15a1a22ed9]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7a697165-ae63-4c4c-b63a-ec99ad129517 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed" returned: 0 in 0.318s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5f2f7b9e-4bf5-4b93-85a2-442cbe950753 tempest-CinderUnicodeTest-718313513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.082s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:12 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-5f2f7b9e-4bf5-4b93-85a2-442cbe950753 tempest-CinderUnicodeTest-718313513 None] Creating offline snapshot 21d4ac72-49e9-46a2-9528-831245fb5ea2 of volume cac9f702-fb10-471b-81f7-2b78b6f12502 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:05:12 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a48890-d8b1-4110-be8f-3c9f07a850ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc49251d-27c9-410e-893b-9943d2a5e7ed', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:12 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5128f770-ad1c-4d01-b95e-dabe7de55af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:12 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6d97c3-cc8c-4d1e-8971-cd459cbfc09e]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5f2f7b9e-4bf5-4b93-85a2-442cbe950753 tempest-CinderUnicodeTest-718313513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:12 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Volume volume-fc49251d-27c9-410e-893b-9943d2a5e7ed (fc49251d-27c9-410e-893b-9943d2a5e7ed): created successfully Sep 07 14:05:12 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5128f770-ad1c-4d01-b95e-dabe7de55af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:12 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Flow 'volume_create_manager' (9e35d1c9-efbb-438b-be24-3b770a75d863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:12 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-617aa25f-a9c8-4b84-9de6-eee588a88f7b tempest-ProjectReaderTests-2123950541 None] Created volume successfully. Sep 07 14:05:12 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5 Sep 07 14:05:12 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:12 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502 Sep 07 14:05:12 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:12 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7a697165-ae63-4c4c-b63a-ec99ad129517 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5" returned: 0 in 0.400s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7a697165-ae63-4c4c-b63a-ec99ad129517 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.147f74fd-14e4-435c-81e5-54801b1c3d70 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:12 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.147f74fd-14e4-435c-81e5-54801b1c3d70 Sep 07 14:05:12 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:12 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5f2f7b9e-4bf5-4b93-85a2-442cbe950753 tempest-CinderUnicodeTest-718313513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502" returned: 0 in 0.391s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:12 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5f2f7b9e-4bf5-4b93-85a2-442cbe950753 tempest-CinderUnicodeTest-718313513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.21d4ac72-49e9-46a2-9528-831245fb5ea2 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:12 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.21d4ac72-49e9-46a2-9528-831245fb5ea2 1G Sep 07 14:05:12 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:13 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7a697165-ae63-4c4c-b63a-ec99ad129517 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.147f74fd-14e4-435c-81e5-54801b1c3d70" returned: 0 in 0.327s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7a697165-ae63-4c4c-b63a-ec99ad129517 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.147f74fd-14e4-435c-81e5-54801b1c3d70 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:13 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.147f74fd-14e4-435c-81e5-54801b1c3d70 Sep 07 14:05:13 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:13 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5f2f7b9e-4bf5-4b93-85a2-442cbe950753 tempest-CinderUnicodeTest-718313513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.21d4ac72-49e9-46a2-9528-831245fb5ea2 1G" returned: 0 in 0.404s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5f2f7b9e-4bf5-4b93-85a2-442cbe950753 tempest-CinderUnicodeTest-718313513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac9f702-fb10-471b-81f7-2b78b6f12502 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.21d4ac72-49e9-46a2-9528-831245fb5ea2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:13 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac9f702-fb10-471b-81f7-2b78b6f12502 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.21d4ac72-49e9-46a2-9528-831245fb5ea2 Sep 07 14:05:13 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:13 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7a697165-ae63-4c4c-b63a-ec99ad129517 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5.147f74fd-14e4-435c-81e5-54801b1c3d70" returned: 0 in 0.260s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7a697165-ae63-4c4c-b63a-ec99ad129517 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-147f74fd-14e4-435c-81e5-54801b1c3d70" released by "_delete_snapshot" :: held 1.478s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7a697165-ae63-4c4c-b63a-ec99ad129517 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5" released by "delete_snapshot" :: held 1.503s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:13 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-7a697165-ae63-4c4c-b63a-ec99ad129517 tempest-ProjectMemberTests-1858363890 None] Created reservations ['89e3ef0b-7ad9-4994-be6f-f6b8b1bf1483', '460446e7-2c5a-4ecb-964c-e0891dec2343', '39c7f955-0d4b-4457-9eaf-ec374409a731', '34b9c7bc-4409-4dcf-896d-e008d1429c6f'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:13 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-7a697165-ae63-4c4c-b63a-ec99ad129517 tempest-ProjectMemberTests-1858363890 None] Delete snapshot completed successfully. Sep 07 14:05:13 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7a697165-ae63-4c4c-b63a-ec99ad129517 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-147f74fd-14e4-435c-81e5-54801b1c3d70-delete_snapshot" released by "delete_snapshot" :: held 1.677s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:13 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5f2f7b9e-4bf5-4b93-85a2-442cbe950753 tempest-CinderUnicodeTest-718313513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac9f702-fb10-471b-81f7-2b78b6f12502 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.21d4ac72-49e9-46a2-9528-831245fb5ea2" returned: 0 in 0.382s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:13 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-5f2f7b9e-4bf5-4b93-85a2-442cbe950753 tempest-CinderUnicodeTest-718313513 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.21d4ac72-49e9-46a2-9528-831245fb5ea2 is being set with open permissions: ugo+rw Sep 07 14:05:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5f2f7b9e-4bf5-4b93-85a2-442cbe950753 tempest-CinderUnicodeTest-718313513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.21d4ac72-49e9-46a2-9528-831245fb5ea2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:13 devstack sudo[108544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.21d4ac72-49e9-46a2-9528-831245fb5ea2 Sep 07 14:05:13 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5fd7b8d6-90c7-4ec2-bca8-d63d734bd44f tempest-ProjectReaderTests-2123950541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:13 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5f2f7b9e-4bf5-4b93-85a2-442cbe950753 tempest-CinderUnicodeTest-718313513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.21d4ac72-49e9-46a2-9528-831245fb5ea2" returned: 0 in 0.261s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:13 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5f2f7b9e-4bf5-4b93-85a2-442cbe950753 tempest-CinderUnicodeTest-718313513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:13 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.info Sep 07 14:05:13 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9aecc632-b681-4c38-b8e9-e5a6054d8ce1 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9aecc632-b681-4c38-b8e9-e5a6054d8ce1 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9aecc632-b681-4c38-b8e9-e5a6054d8ce1 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9aecc632-b681-4c38-b8e9-e5a6054d8ce1 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5" acquired by "delete_volume" :: waited 0.014s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b1a7df-47f0-4c68-ae74-ad949ee3dabd]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9aecc632-b681-4c38-b8e9-e5a6054d8ce1 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:14 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5f2f7b9e-4bf5-4b93-85a2-442cbe950753 tempest-CinderUnicodeTest-718313513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.info" returned: 0 in 0.263s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:14 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-5f2f7b9e-4bf5-4b93-85a2-442cbe950753 tempest-CinderUnicodeTest-718313513 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.info is being set with open permissions: ugo+rw Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5f2f7b9e-4bf5-4b93-85a2-442cbe950753 tempest-CinderUnicodeTest-718313513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:14 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.info Sep 07 14:05:14 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:14 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5 Sep 07 14:05:14 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:14 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5f2f7b9e-4bf5-4b93-85a2-442cbe950753 tempest-CinderUnicodeTest-718313513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.info" returned: 0 in 0.260s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5f2f7b9e-4bf5-4b93-85a2-442cbe950753 tempest-CinderUnicodeTest-718313513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.064s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5fd7b8d6-90c7-4ec2-bca8-d63d734bd44f tempest-ProjectReaderTests-2123950541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.699s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-5fd7b8d6-90c7-4ec2-bca8-d63d734bd44f tempest-ProjectReaderTests-2123950541 None] Creating offline snapshot 10df0680-577e-451d-a6eb-64381fde6734 of volume fc49251d-27c9-410e-893b-9943d2a5e7ed {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:05:14 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9aecc632-b681-4c38-b8e9-e5a6054d8ce1 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5" returned: 0 in 0.383s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9aecc632-b681-4c38-b8e9-e5a6054d8ce1 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:14 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-5f2f7b9e-4bf5-4b93-85a2-442cbe950753 tempest-CinderUnicodeTest-718313513 None] Create snapshot completed successfully Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eba7306-5d24-4991-bf1b-a797c8570626]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7b8d6-90c7-4ec2-bca8-d63d734bd44f tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:14 devstack sudo[108558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5 Sep 07 14:05:14 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:14 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed Sep 07 14:05:14 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:14 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9aecc632-b681-4c38-b8e9-e5a6054d8ce1 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5" returned: 0 in 0.283s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9aecc632-b681-4c38-b8e9-e5a6054d8ce1 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5" released by "delete_volume" :: held 0.722s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-9aecc632-b681-4c38-b8e9-e5a6054d8ce1 tempest-ProjectMemberTests-1858363890 None] Created reservations ['8722598d-6c3d-4199-816f-bd92a386fe25', 'd659f3f6-3a54-4338-9cda-b889672cf0b9', '4081d02d-354a-4582-9a31-a2958b935260', '53bb41d6-b92c-4aae-99f9-b96af7829cda'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:14 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7b8d6-90c7-4ec2-bca8-d63d734bd44f tempest-ProjectReaderTests-2123950541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed" returned: 0 in 0.384s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7b8d6-90c7-4ec2-bca8-d63d734bd44f tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.10df0680-577e-451d-a6eb-64381fde6734 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9aecc632-b681-4c38-b8e9-e5a6054d8ce1 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9aecc632-b681-4c38-b8e9-e5a6054d8ce1 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9aecc632-b681-4c38-b8e9-e5a6054d8ce1 tempest-ProjectMemberTests-1858363890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:14 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.10df0680-577e-451d-a6eb-64381fde6734 1G Sep 07 14:05:14 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9aecc632-b681-4c38-b8e9-e5a6054d8ce1 tempest-ProjectMemberTests-1858363890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9aecc632-b681-4c38-b8e9-e5a6054d8ce1 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:14 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9aecc632-b681-4c38-b8e9-e5a6054d8ce1 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:14 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:05:14 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:15 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9aecc632-b681-4c38-b8e9-e5a6054d8ce1 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.247s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-9aecc632-b681-4c38-b8e9-e5a6054d8ce1 tempest-ProjectMemberTests-1858363890 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:15 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-9aecc632-b681-4c38-b8e9-e5a6054d8ce1 tempest-ProjectMemberTests-1858363890 None] Deleted volume successfully. Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9aecc632-b681-4c38-b8e9-e5a6054d8ce1 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-93ba8cce-03a1-41ec-b7ce-f5e72e62b5c5-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:15 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7b8d6-90c7-4ec2-bca8-d63d734bd44f tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.10df0680-577e-451d-a6eb-64381fde6734 1G" returned: 0 in 0.472s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7b8d6-90c7-4ec2-bca8-d63d734bd44f tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc49251d-27c9-410e-893b-9943d2a5e7ed -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.10df0680-577e-451d-a6eb-64381fde6734 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:15 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc49251d-27c9-410e-893b-9943d2a5e7ed -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.10df0680-577e-451d-a6eb-64381fde6734 Sep 07 14:05:15 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3e2884bd-048a-4376-a0fe-c4f4d9b399b8 tempest-CinderUnicodeTest-718313513 None] Acquiring lock "cinder-21d4ac72-49e9-46a2-9528-831245fb5ea2-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3e2884bd-048a-4376-a0fe-c4f4d9b399b8 tempest-CinderUnicodeTest-718313513 None] Lock "cinder-21d4ac72-49e9-46a2-9528-831245fb5ea2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3e2884bd-048a-4376-a0fe-c4f4d9b399b8 tempest-CinderUnicodeTest-718313513 None] Acquiring lock "cinder-quobyte-cac9f702-fb10-471b-81f7-2b78b6f12502" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3e2884bd-048a-4376-a0fe-c4f4d9b399b8 tempest-CinderUnicodeTest-718313513 None] Lock "cinder-quobyte-cac9f702-fb10-471b-81f7-2b78b6f12502" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3e2884bd-048a-4376-a0fe-c4f4d9b399b8 tempest-CinderUnicodeTest-718313513 None] Acquiring lock "cinder-quobyte-21d4ac72-49e9-46a2-9528-831245fb5ea2" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3e2884bd-048a-4376-a0fe-c4f4d9b399b8 tempest-CinderUnicodeTest-718313513 None] Lock "cinder-quobyte-21d4ac72-49e9-46a2-9528-831245fb5ea2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-3e2884bd-048a-4376-a0fe-c4f4d9b399b8 tempest-CinderUnicodeTest-718313513 None] Deleting offline snapshot 21d4ac72-49e9-46a2-9528-831245fb5ea2 of volume cac9f702-fb10-471b-81f7-2b78b6f12502 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-3e2884bd-048a-4376-a0fe-c4f4d9b399b8 tempest-CinderUnicodeTest-718313513 None] snapshot_file for this snap is: volume-cac9f702-fb10-471b-81f7-2b78b6f12502.21d4ac72-49e9-46a2-9528-831245fb5ea2 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c861b0-2f63-4849-8878-7339a4035492]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3e2884bd-048a-4376-a0fe-c4f4d9b399b8 tempest-CinderUnicodeTest-718313513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.21d4ac72-49e9-46a2-9528-831245fb5ea2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:05:15 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.21d4ac72-49e9-46a2-9528-831245fb5ea2 Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Flow 'volume_create_manager' (302b018e-f62b-4a64-a441-b659ea27e9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:15 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5306a3ea-2353-4f41-94cf-ae9bda24843f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:15 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5306a3ea-2353-4f41-94cf-ae9bda24843f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-310143823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095048c8-2399-45b8-ab28-b7be08c348d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8fd9674bb249b899d5c69373880941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:16Z,use_quota=True,user_id='30c462f1a0094053b9f39392ba6e3442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a27ae0f-d649-48df-a000-1b2c8a5e79c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a27ae0f-d649-48df-a000-1b2c8a5e79c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84cbcb6f-9c9e-4e3f-8aad-15881208c885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84cbcb6f-9c9e-4e3f-8aad-15881208c885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '095048c8-2399-45b8-ab28-b7be08c348d5', 'volume_name': 'volume-095048c8-2399-45b8-ab28-b7be08c348d5', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d395a07-8ad3-4b48-9cff-4c2fb04cc619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d395a07-8ad3-4b48-9cff-4c2fb04cc619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74440fb0-2a3c-4b8a-b171-df7f6d59a81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:15 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Volume 095048c8-2399-45b8-ab28-b7be08c348d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-095048c8-2399-45b8-ab28-b7be08c348d5', 'volume_size': 1} Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7b8d6-90c7-4ec2-bca8-d63d734bd44f tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc49251d-27c9-410e-893b-9943d2a5e7ed -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.10df0680-577e-451d-a6eb-64381fde6734" returned: 0 in 0.426s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:15 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-5fd7b8d6-90c7-4ec2-bca8-d63d734bd44f tempest-ProjectReaderTests-2123950541 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.10df0680-577e-451d-a6eb-64381fde6734 is being set with open permissions: ugo+rw Sep 07 14:05:15 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7b8d6-90c7-4ec2-bca8-d63d734bd44f tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.10df0680-577e-451d-a6eb-64381fde6734 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:15 devstack sudo[108584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.10df0680-577e-451d-a6eb-64381fde6734 Sep 07 14:05:15 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:16 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3e2884bd-048a-4376-a0fe-c4f4d9b399b8 tempest-CinderUnicodeTest-718313513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.21d4ac72-49e9-46a2-9528-831245fb5ea2" returned: 0 in 0.408s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-3e2884bd-048a-4376-a0fe-c4f4d9b399b8 tempest-CinderUnicodeTest-718313513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cac9f702-fb10-471b-81f7-2b78b6f12502(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9641ac-7f9b-46ec-8f34-3777d0c5a891]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3e2884bd-048a-4376-a0fe-c4f4d9b399b8 tempest-CinderUnicodeTest-718313513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:16 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7b8d6-90c7-4ec2-bca8-d63d734bd44f tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.10df0680-577e-451d-a6eb-64381fde6734" returned: 0 in 0.275s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7b8d6-90c7-4ec2-bca8-d63d734bd44f tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:16 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.info Sep 07 14:05:16 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:16 devstack sudo[108590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502 Sep 07 14:05:16 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:16 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7b8d6-90c7-4ec2-bca8-d63d734bd44f tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.info" returned: 0 in 0.246s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:16 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-5fd7b8d6-90c7-4ec2-bca8-d63d734bd44f tempest-ProjectReaderTests-2123950541 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.info is being set with open permissions: ugo+rw Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7b8d6-90c7-4ec2-bca8-d63d734bd44f tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:16 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.info Sep 07 14:05:16 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:16 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3e2884bd-048a-4376-a0fe-c4f4d9b399b8 tempest-CinderUnicodeTest-718313513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502" returned: 0 in 0.389s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3e2884bd-048a-4376-a0fe-c4f4d9b399b8 tempest-CinderUnicodeTest-718313513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.21d4ac72-49e9-46a2-9528-831245fb5ea2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:16 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.21d4ac72-49e9-46a2-9528-831245fb5ea2 Sep 07 14:05:16 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:16 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5fd7b8d6-90c7-4ec2-bca8-d63d734bd44f tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.info" returned: 0 in 0.239s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-5fd7b8d6-90c7-4ec2-bca8-d63d734bd44f tempest-ProjectReaderTests-2123950541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.161s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.825s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-310143823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095048c8-2399-45b8-ab28-b7be08c348d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8fd9674bb249b899d5c69373880941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:16Z,use_quota=True,user_id='30c462f1a0094053b9f39392ba6e3442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Creating volume 095048c8-2399-45b8-ab28-b7be08c348d5 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:16 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:16 devstack sudo[108604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5 1073741824 Sep 07 14:05:16 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:16 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-5fd7b8d6-90c7-4ec2-bca8-d63d734bd44f tempest-ProjectReaderTests-2123950541 None] Create snapshot completed successfully Sep 07 14:05:16 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3e2884bd-048a-4376-a0fe-c4f4d9b399b8 tempest-CinderUnicodeTest-718313513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.21d4ac72-49e9-46a2-9528-831245fb5ea2" returned: 0 in 0.367s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3e2884bd-048a-4376-a0fe-c4f4d9b399b8 tempest-CinderUnicodeTest-718313513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.21d4ac72-49e9-46a2-9528-831245fb5ea2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:16 devstack sudo[108609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.21d4ac72-49e9-46a2-9528-831245fb5ea2 Sep 07 14:05:16 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7e671505-2361-4d20-9d1e-21ecd3afad34 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-10df0680-577e-451d-a6eb-64381fde6734-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7e671505-2361-4d20-9d1e-21ecd3afad34 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-10df0680-577e-451d-a6eb-64381fde6734-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:16 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7e671505-2361-4d20-9d1e-21ecd3afad34 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-quobyte-fc49251d-27c9-410e-893b-9943d2a5e7ed" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7e671505-2361-4d20-9d1e-21ecd3afad34 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-fc49251d-27c9-410e-893b-9943d2a5e7ed" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7e671505-2361-4d20-9d1e-21ecd3afad34 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-quobyte-10df0680-577e-451d-a6eb-64381fde6734" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7e671505-2361-4d20-9d1e-21ecd3afad34 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-10df0680-577e-451d-a6eb-64381fde6734" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-7e671505-2361-4d20-9d1e-21ecd3afad34 tempest-ProjectReaderTests-2123950541 None] Deleting offline snapshot 10df0680-577e-451d-a6eb-64381fde6734 of volume fc49251d-27c9-410e-893b-9943d2a5e7ed {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-7e671505-2361-4d20-9d1e-21ecd3afad34 tempest-ProjectReaderTests-2123950541 None] snapshot_file for this snap is: volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.10df0680-577e-451d-a6eb-64381fde6734 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[152e2074-2ce1-4386-88cc-f03644cf7ab5]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7e671505-2361-4d20-9d1e-21ecd3afad34 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.10df0680-577e-451d-a6eb-64381fde6734 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:17 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3e2884bd-048a-4376-a0fe-c4f4d9b399b8 tempest-CinderUnicodeTest-718313513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502.21d4ac72-49e9-46a2-9528-831245fb5ea2" returned: 0 in 0.295s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:17 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5 1073741824" returned: 0 in 0.516s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3e2884bd-048a-4376-a0fe-c4f4d9b399b8 tempest-CinderUnicodeTest-718313513 None] Lock "cinder-quobyte-21d4ac72-49e9-46a2-9528-831245fb5ea2" released by "_delete_snapshot" :: held 1.594s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3e2884bd-048a-4376-a0fe-c4f4d9b399b8 tempest-CinderUnicodeTest-718313513 None] Lock "cinder-quobyte-cac9f702-fb10-471b-81f7-2b78b6f12502" released by "delete_snapshot" :: held 1.621s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:17 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.10df0680-577e-451d-a6eb-64381fde6734 Sep 07 14:05:17 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:17 devstack sudo[108618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5 Sep 07 14:05:17 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-3e2884bd-048a-4376-a0fe-c4f4d9b399b8 tempest-CinderUnicodeTest-718313513 None] Created reservations ['8eaa777e-e81d-4abf-ad01-db21e8ae5e18', 'e8dd204e-c870-4f43-9ffe-5e4872c79666', '97d6b2a9-adbb-480e-95d5-3ab20319959e', '8c6393e1-2a93-4e45-bcbf-6a611632c150'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:17 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-3e2884bd-048a-4376-a0fe-c4f4d9b399b8 tempest-CinderUnicodeTest-718313513 None] Delete snapshot completed successfully. Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3e2884bd-048a-4376-a0fe-c4f4d9b399b8 tempest-CinderUnicodeTest-718313513 None] Lock "cinder-21d4ac72-49e9-46a2-9528-831245fb5ea2-delete_snapshot" released by "delete_snapshot" :: held 1.800s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:17 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7e671505-2361-4d20-9d1e-21ecd3afad34 tempest-ProjectReaderTests-2123950541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.10df0680-577e-451d-a6eb-64381fde6734" returned: 0 in 0.376s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-7e671505-2361-4d20-9d1e-21ecd3afad34 tempest-ProjectReaderTests-2123950541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc49251d-27c9-410e-893b-9943d2a5e7ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9097c11d-e431-4b62-8790-e472b66bddd2]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7e671505-2361-4d20-9d1e-21ecd3afad34 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:17 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5" returned: 0 in 0.276s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74440fb0-2a3c-4b8a-b171-df7f6d59a81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-095048c8-2399-45b8-ab28-b7be08c348d5', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e682cec-7557-4c5a-808b-56b6a0c6458c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:17 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Volume volume-095048c8-2399-45b8-ab28-b7be08c348d5 (095048c8-2399-45b8-ab28-b7be08c348d5): created successfully Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e682cec-7557-4c5a-808b-56b6a0c6458c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Flow 'volume_create_manager' (302b018e-f62b-4a64-a441-b659ea27e9e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:17 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-48b081c1-00f9-4b71-9451-1638338b49dd tempest-ProjectMemberTests-1858363890 None] Created volume successfully. Sep 07 14:05:17 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed Sep 07 14:05:17 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ba804b34-d427-4290-bdad-df52b9c6f65e tempest-CinderUnicodeTest-718313513 None] Acquiring lock "cinder-cac9f702-fb10-471b-81f7-2b78b6f12502-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ba804b34-d427-4290-bdad-df52b9c6f65e tempest-CinderUnicodeTest-718313513 None] Lock "cinder-cac9f702-fb10-471b-81f7-2b78b6f12502-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ba804b34-d427-4290-bdad-df52b9c6f65e tempest-CinderUnicodeTest-718313513 None] Acquiring lock "cinder-quobyte-cac9f702-fb10-471b-81f7-2b78b6f12502" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ba804b34-d427-4290-bdad-df52b9c6f65e tempest-CinderUnicodeTest-718313513 None] Lock "cinder-quobyte-cac9f702-fb10-471b-81f7-2b78b6f12502" acquired by "delete_volume" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[907b6e77-7a4e-4e23-9c34-fc3977620774]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ba804b34-d427-4290-bdad-df52b9c6f65e tempest-CinderUnicodeTest-718313513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:17 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7e671505-2361-4d20-9d1e-21ecd3afad34 tempest-ProjectReaderTests-2123950541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed" returned: 0 in 0.405s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:17 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7e671505-2361-4d20-9d1e-21ecd3afad34 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.10df0680-577e-451d-a6eb-64381fde6734 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:17 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.10df0680-577e-451d-a6eb-64381fde6734 Sep 07 14:05:17 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:17 devstack sudo[108629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502 Sep 07 14:05:17 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e4878b47-9b03-440d-b937-006bfc09b66c tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e4878b47-9b03-440d-b937-006bfc09b66c tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-e4878b47-9b03-440d-b937-006bfc09b66c tempest-ProjectMemberTests-1858363890 None] Creating offline snapshot aca56584-a990-45c7-ab66-35fd1854bcb0 of volume 095048c8-2399-45b8-ab28-b7be08c348d5 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[093ed7ea-789e-4160-a303-61293dcf2016]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e4878b47-9b03-440d-b937-006bfc09b66c tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:18 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5 Sep 07 14:05:18 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:18 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ba804b34-d427-4290-bdad-df52b9c6f65e tempest-CinderUnicodeTest-718313513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502" returned: 0 in 0.442s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ba804b34-d427-4290-bdad-df52b9c6f65e tempest-CinderUnicodeTest-718313513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:18 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502 Sep 07 14:05:18 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:18 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7e671505-2361-4d20-9d1e-21ecd3afad34 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.10df0680-577e-451d-a6eb-64381fde6734" returned: 0 in 0.440s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7e671505-2361-4d20-9d1e-21ecd3afad34 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.10df0680-577e-451d-a6eb-64381fde6734 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:18 devstack sudo[108645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.10df0680-577e-451d-a6eb-64381fde6734 Sep 07 14:05:18 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:18 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e4878b47-9b03-440d-b937-006bfc09b66c tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5" returned: 0 in 0.429s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e4878b47-9b03-440d-b937-006bfc09b66c tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.aca56584-a990-45c7-ab66-35fd1854bcb0 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:18 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ba804b34-d427-4290-bdad-df52b9c6f65e tempest-CinderUnicodeTest-718313513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-cac9f702-fb10-471b-81f7-2b78b6f12502" returned: 0 in 0.276s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:18 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.aca56584-a990-45c7-ab66-35fd1854bcb0 1G Sep 07 14:05:18 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ba804b34-d427-4290-bdad-df52b9c6f65e tempest-CinderUnicodeTest-718313513 None] Lock "cinder-quobyte-cac9f702-fb10-471b-81f7-2b78b6f12502" released by "delete_volume" :: held 0.788s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:18 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-7e671505-2361-4d20-9d1e-21ecd3afad34 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed.10df0680-577e-451d-a6eb-64381fde6734" returned: 0 in 0.277s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-ba804b34-d427-4290-bdad-df52b9c6f65e tempest-CinderUnicodeTest-718313513 None] Created reservations ['5f67f0f2-e732-43ae-a07a-b5d692b20ca6', '04a8d73b-0cc7-472f-826c-9fae4abc6ed5', '6f4f152b-0b39-43b2-af00-8214ca772d4a', 'c3db8973-6ff4-497c-902a-279a56b30881'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7e671505-2361-4d20-9d1e-21ecd3afad34 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-10df0680-577e-451d-a6eb-64381fde6734" released by "_delete_snapshot" :: held 1.603s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7e671505-2361-4d20-9d1e-21ecd3afad34 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-fc49251d-27c9-410e-893b-9943d2a5e7ed" released by "delete_snapshot" :: held 1.634s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ba804b34-d427-4290-bdad-df52b9c6f65e tempest-CinderUnicodeTest-718313513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ba804b34-d427-4290-bdad-df52b9c6f65e tempest-CinderUnicodeTest-718313513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ba804b34-d427-4290-bdad-df52b9c6f65e tempest-CinderUnicodeTest-718313513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-ba804b34-d427-4290-bdad-df52b9c6f65e tempest-CinderUnicodeTest-718313513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-ba804b34-d427-4290-bdad-df52b9c6f65e tempest-CinderUnicodeTest-718313513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ba804b34-d427-4290-bdad-df52b9c6f65e tempest-CinderUnicodeTest-718313513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-7e671505-2361-4d20-9d1e-21ecd3afad34 tempest-ProjectReaderTests-2123950541 None] Created reservations ['49620ab2-6881-4b69-8739-0a5f2c0c30d9', '93c8f3cc-dfbc-43ae-82dd-678cffa0f1b9', 'dc099606-f998-4bc7-b0f2-9bfccd5a2024', '76cc204e-faa3-46a6-85f8-6258a4cca995'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:18 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:05:18 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:18 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-7e671505-2361-4d20-9d1e-21ecd3afad34 tempest-ProjectReaderTests-2123950541 None] Delete snapshot completed successfully. Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-7e671505-2361-4d20-9d1e-21ecd3afad34 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-10df0680-577e-451d-a6eb-64381fde6734-delete_snapshot" released by "delete_snapshot" :: held 1.847s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f9b8ff00-dbd0-4c56-bcb7-4374c53e6492 tempest-CinderUnicodeTest-718313513 None] Acquiring lock "cinder-a408428d-c206-4fb3-a7ea-bd79971f8516-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f9b8ff00-dbd0-4c56-bcb7-4374c53e6492 tempest-CinderUnicodeTest-718313513 None] Lock "cinder-a408428d-c206-4fb3-a7ea-bd79971f8516-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f9b8ff00-dbd0-4c56-bcb7-4374c53e6492 tempest-CinderUnicodeTest-718313513 None] Acquiring lock "cinder-quobyte-a408428d-c206-4fb3-a7ea-bd79971f8516" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f9b8ff00-dbd0-4c56-bcb7-4374c53e6492 tempest-CinderUnicodeTest-718313513 None] Lock "cinder-quobyte-a408428d-c206-4fb3-a7ea-bd79971f8516" acquired by "delete_volume" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bec7179-a027-4fa4-ad8c-ddf690f1ac6f]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:18 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f9b8ff00-dbd0-4c56-bcb7-4374c53e6492 tempest-CinderUnicodeTest-718313513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a408428d-c206-4fb3-a7ea-bd79971f8516 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:19 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e4878b47-9b03-440d-b937-006bfc09b66c tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.aca56584-a990-45c7-ab66-35fd1854bcb0 1G" returned: 0 in 0.494s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e4878b47-9b03-440d-b937-006bfc09b66c tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-095048c8-2399-45b8-ab28-b7be08c348d5 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.aca56584-a990-45c7-ab66-35fd1854bcb0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:19 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-095048c8-2399-45b8-ab28-b7be08c348d5 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.aca56584-a990-45c7-ab66-35fd1854bcb0 Sep 07 14:05:19 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:19 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-ba804b34-d427-4290-bdad-df52b9c6f65e tempest-CinderUnicodeTest-718313513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.363s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-ba804b34-d427-4290-bdad-df52b9c6f65e tempest-CinderUnicodeTest-718313513 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:19 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-ba804b34-d427-4290-bdad-df52b9c6f65e tempest-CinderUnicodeTest-718313513 None] Deleted volume successfully. Sep 07 14:05:19 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a408428d-c206-4fb3-a7ea-bd79971f8516 Sep 07 14:05:19 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-ba804b34-d427-4290-bdad-df52b9c6f65e tempest-CinderUnicodeTest-718313513 None] Lock "cinder-cac9f702-fb10-471b-81f7-2b78b6f12502-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-371194ed-c473-4ea7-980d-b701222d34a4 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-fc49251d-27c9-410e-893b-9943d2a5e7ed-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-371194ed-c473-4ea7-980d-b701222d34a4 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-fc49251d-27c9-410e-893b-9943d2a5e7ed-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-371194ed-c473-4ea7-980d-b701222d34a4 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-quobyte-fc49251d-27c9-410e-893b-9943d2a5e7ed" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-371194ed-c473-4ea7-980d-b701222d34a4 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-fc49251d-27c9-410e-893b-9943d2a5e7ed" acquired by "delete_volume" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a29972-9a0c-42ad-9a25-4d28c5038b30]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-371194ed-c473-4ea7-980d-b701222d34a4 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:19 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e4878b47-9b03-440d-b937-006bfc09b66c tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-095048c8-2399-45b8-ab28-b7be08c348d5 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.aca56584-a990-45c7-ab66-35fd1854bcb0" returned: 0 in 0.341s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:19 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-e4878b47-9b03-440d-b937-006bfc09b66c tempest-ProjectMemberTests-1858363890 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.aca56584-a990-45c7-ab66-35fd1854bcb0 is being set with open permissions: ugo+rw Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e4878b47-9b03-440d-b937-006bfc09b66c tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.aca56584-a990-45c7-ab66-35fd1854bcb0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:19 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.aca56584-a990-45c7-ab66-35fd1854bcb0 Sep 07 14:05:19 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:19 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f9b8ff00-dbd0-4c56-bcb7-4374c53e6492 tempest-CinderUnicodeTest-718313513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a408428d-c206-4fb3-a7ea-bd79971f8516" returned: 0 in 0.448s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f9b8ff00-dbd0-4c56-bcb7-4374c53e6492 tempest-CinderUnicodeTest-718313513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a408428d-c206-4fb3-a7ea-bd79971f8516 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:19 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed Sep 07 14:05:19 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:19 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a408428d-c206-4fb3-a7ea-bd79971f8516 Sep 07 14:05:19 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:19 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e4878b47-9b03-440d-b937-006bfc09b66c tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.aca56584-a990-45c7-ab66-35fd1854bcb0" returned: 0 in 0.285s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e4878b47-9b03-440d-b937-006bfc09b66c tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:19 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f9b8ff00-dbd0-4c56-bcb7-4374c53e6492 tempest-CinderUnicodeTest-718313513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-a408428d-c206-4fb3-a7ea-bd79971f8516" returned: 0 in 0.271s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:19 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.info Sep 07 14:05:19 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f9b8ff00-dbd0-4c56-bcb7-4374c53e6492 tempest-CinderUnicodeTest-718313513 None] Lock "cinder-quobyte-a408428d-c206-4fb3-a7ea-bd79971f8516" released by "delete_volume" :: held 0.769s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:19 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-371194ed-c473-4ea7-980d-b701222d34a4 tempest-ProjectReaderTests-2123950541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed" returned: 0 in 0.428s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-371194ed-c473-4ea7-980d-b701222d34a4 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:19 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed Sep 07 14:05:19 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-f9b8ff00-dbd0-4c56-bcb7-4374c53e6492 tempest-CinderUnicodeTest-718313513 None] Created reservations ['c69c79fb-37ef-4241-9d94-e5855294b9c5', '6eb9792b-7641-4f91-99b7-f44deb00f7b2', '7c0694f3-8107-49e6-87f9-f2ff4ae0e428', 'a10e03bc-0935-4b24-8565-32b95c83f2d0'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f9b8ff00-dbd0-4c56-bcb7-4374c53e6492 tempest-CinderUnicodeTest-718313513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f9b8ff00-dbd0-4c56-bcb7-4374c53e6492 tempest-CinderUnicodeTest-718313513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f9b8ff00-dbd0-4c56-bcb7-4374c53e6492 tempest-CinderUnicodeTest-718313513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-f9b8ff00-dbd0-4c56-bcb7-4374c53e6492 tempest-CinderUnicodeTest-718313513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-f9b8ff00-dbd0-4c56-bcb7-4374c53e6492 tempest-CinderUnicodeTest-718313513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f9b8ff00-dbd0-4c56-bcb7-4374c53e6492 tempest-CinderUnicodeTest-718313513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:19 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:05:19 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:19 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e4878b47-9b03-440d-b937-006bfc09b66c tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.info" returned: 0 in 0.268s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:19 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-e4878b47-9b03-440d-b937-006bfc09b66c tempest-ProjectMemberTests-1858363890 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.info is being set with open permissions: ugo+rw Sep 07 14:05:19 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e4878b47-9b03-440d-b937-006bfc09b66c tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:19 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.info Sep 07 14:05:19 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:20 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-371194ed-c473-4ea7-980d-b701222d34a4 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fc49251d-27c9-410e-893b-9943d2a5e7ed" returned: 0 in 0.322s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-371194ed-c473-4ea7-980d-b701222d34a4 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-fc49251d-27c9-410e-893b-9943d2a5e7ed" released by "delete_volume" :: held 0.822s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:20 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-f9b8ff00-dbd0-4c56-bcb7-4374c53e6492 tempest-CinderUnicodeTest-718313513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.271s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-f9b8ff00-dbd0-4c56-bcb7-4374c53e6492 tempest-CinderUnicodeTest-718313513 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:20 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-f9b8ff00-dbd0-4c56-bcb7-4374c53e6492 tempest-CinderUnicodeTest-718313513 None] Deleted volume successfully. Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-371194ed-c473-4ea7-980d-b701222d34a4 tempest-ProjectReaderTests-2123950541 None] Created reservations ['7e34af38-cef6-4a8d-a5e6-8dfd9e6a5224', 'ab3f7332-ff24-4233-b2f2-6ae75e865658', 'a0720e30-0ab1-4f83-b7ab-1fde563482d7', 'c08d751d-b4f3-453b-9066-46762ac6ee4a'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-f9b8ff00-dbd0-4c56-bcb7-4374c53e6492 tempest-CinderUnicodeTest-718313513 None] Lock "cinder-a408428d-c206-4fb3-a7ea-bd79971f8516-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-371194ed-c473-4ea7-980d-b701222d34a4 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-371194ed-c473-4ea7-980d-b701222d34a4 tempest-ProjectReaderTests-2123950541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-371194ed-c473-4ea7-980d-b701222d34a4 tempest-ProjectReaderTests-2123950541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-371194ed-c473-4ea7-980d-b701222d34a4 tempest-ProjectReaderTests-2123950541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-371194ed-c473-4ea7-980d-b701222d34a4 tempest-ProjectReaderTests-2123950541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-371194ed-c473-4ea7-980d-b701222d34a4 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:20 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-e4878b47-9b03-440d-b937-006bfc09b66c tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.info" returned: 0 in 0.322s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:20 devstack sudo[108694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:05:20 devstack sudo[108694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-e4878b47-9b03-440d-b937-006bfc09b66c tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.253s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:20 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-e4878b47-9b03-440d-b937-006bfc09b66c tempest-ProjectMemberTests-1858363890 None] Create snapshot completed successfully Sep 07 14:05:20 devstack sudo[108694]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-371194ed-c473-4ea7-980d-b701222d34a4 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.309s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-371194ed-c473-4ea7-980d-b701222d34a4 tempest-ProjectReaderTests-2123950541 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:20 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-371194ed-c473-4ea7-980d-b701222d34a4 tempest-ProjectReaderTests-2123950541 None] Deleted volume successfully. Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-371194ed-c473-4ea7-980d-b701222d34a4 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-fc49251d-27c9-410e-893b-9943d2a5e7ed-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Flow 'volume_create_manager' (ea2abc86-54bd-4294-a8df-a4a6e3f2e37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97298923-160e-48b1-a81b-cb6b28948594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97298923-160e-48b1-a81b-cb6b28948594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1869896977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9e05d2-149d-479e-b5ee-09f99f86b656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f88686a757b48d2ac1a60b2911cabe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:21Z,use_quota=True,user_id='28a72580cb7e409aa7c0843102d083c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dad7c2c-97f4-453b-85c9-a1318baa5004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dad7c2c-97f4-453b-85c9-a1318baa5004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a607fc04-87fa-4fa8-8c82-dc1bd9975e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a607fc04-87fa-4fa8-8c82-dc1bd9975e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa9e05d2-149d-479e-b5ee-09f99f86b656', 'volume_name': 'volume-aa9e05d2-149d-479e-b5ee-09f99f86b656', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55f8a58-040c-494a-890a-371fb36d85cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55f8a58-040c-494a-890a-371fb36d85cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a561ad-e951-4165-a23b-c5c5ca76ceae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:20 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Volume aa9e05d2-149d-479e-b5ee-09f99f86b656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa9e05d2-149d-479e-b5ee-09f99f86b656', 'volume_size': 1} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1869896977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9e05d2-149d-479e-b5ee-09f99f86b656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f88686a757b48d2ac1a60b2911cabe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:21Z,use_quota=True,user_id='28a72580cb7e409aa7c0843102d083c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Creating volume aa9e05d2-149d-479e-b5ee-09f99f86b656 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:20 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:05:20 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:20 devstack sudo[108697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656 1073741824 Sep 07 14:05:20 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-08898017-f92b-4ebf-9f64-1056fb80b523 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-aca56584-a990-45c7-ab66-35fd1854bcb0-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-08898017-f92b-4ebf-9f64-1056fb80b523 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-aca56584-a990-45c7-ab66-35fd1854bcb0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-08898017-f92b-4ebf-9f64-1056fb80b523 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-095048c8-2399-45b8-ab28-b7be08c348d5" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-08898017-f92b-4ebf-9f64-1056fb80b523 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-095048c8-2399-45b8-ab28-b7be08c348d5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-08898017-f92b-4ebf-9f64-1056fb80b523 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-aca56584-a990-45c7-ab66-35fd1854bcb0" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:21 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-08898017-f92b-4ebf-9f64-1056fb80b523 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-aca56584-a990-45c7-ab66-35fd1854bcb0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-08898017-f92b-4ebf-9f64-1056fb80b523 tempest-ProjectMemberTests-1858363890 None] Deleting offline snapshot aca56584-a990-45c7-ab66-35fd1854bcb0 of volume 095048c8-2399-45b8-ab28-b7be08c348d5 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:05:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-08898017-f92b-4ebf-9f64-1056fb80b523 tempest-ProjectMemberTests-1858363890 None] snapshot_file for this snap is: volume-095048c8-2399-45b8-ab28-b7be08c348d5.aca56584-a990-45c7-ab66-35fd1854bcb0 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:05:21 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc6188b-5c5e-45c6-badd-217798c0b662]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-08898017-f92b-4ebf-9f64-1056fb80b523 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.aca56584-a990-45c7-ab66-35fd1854bcb0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:21 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656 1073741824" returned: 0 in 0.522s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:21 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.aca56584-a990-45c7-ab66-35fd1854bcb0 Sep 07 14:05:21 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:21 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656 Sep 07 14:05:21 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:21 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:21 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656" returned: 0 in 0.273s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-08898017-f92b-4ebf-9f64-1056fb80b523 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.aca56584-a990-45c7-ab66-35fd1854bcb0" returned: 0 in 0.442s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:21 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-08898017-f92b-4ebf-9f64-1056fb80b523 tempest-ProjectMemberTests-1858363890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-095048c8-2399-45b8-ab28-b7be08c348d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:05:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a561ad-e951-4165-a23b-c5c5ca76ceae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa9e05d2-149d-479e-b5ee-09f99f86b656', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5dfb67-db2f-4336-a020-189b95af8c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:21 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5300a02a-e3a3-4686-ad8f-39339a8f6aae]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:21 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-08898017-f92b-4ebf-9f64-1056fb80b523 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:21 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Volume volume-aa9e05d2-149d-479e-b5ee-09f99f86b656 (aa9e05d2-149d-479e-b5ee-09f99f86b656): created successfully Sep 07 14:05:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5dfb67-db2f-4336-a020-189b95af8c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:21 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Flow 'volume_create_manager' (ea2abc86-54bd-4294-a8df-a4a6e3f2e37f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:21 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-b166c902-c413-49a9-9fc2-23c5a816d301 tempest-ProjectReaderTests-2123950541 None] Created volume successfully. Sep 07 14:05:21 devstack sudo[108719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5 Sep 07 14:05:21 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:22 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-08898017-f92b-4ebf-9f64-1056fb80b523 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5" returned: 0 in 0.382s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-08898017-f92b-4ebf-9f64-1056fb80b523 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.aca56584-a990-45c7-ab66-35fd1854bcb0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:22 devstack sudo[108724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.aca56584-a990-45c7-ab66-35fd1854bcb0 Sep 07 14:05:22 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:22 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-08898017-f92b-4ebf-9f64-1056fb80b523 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.aca56584-a990-45c7-ab66-35fd1854bcb0" returned: 0 in 0.339s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-08898017-f92b-4ebf-9f64-1056fb80b523 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.aca56584-a990-45c7-ab66-35fd1854bcb0 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:22 devstack sudo[108729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.aca56584-a990-45c7-ab66-35fd1854bcb0 Sep 07 14:05:22 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:22 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:22 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-08898017-f92b-4ebf-9f64-1056fb80b523 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5.aca56584-a990-45c7-ab66-35fd1854bcb0" returned: 0 in 0.256s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:22 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-08898017-f92b-4ebf-9f64-1056fb80b523 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-aca56584-a990-45c7-ab66-35fd1854bcb0" released by "_delete_snapshot" :: held 1.546s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:22 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-08898017-f92b-4ebf-9f64-1056fb80b523 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-095048c8-2399-45b8-ab28-b7be08c348d5" released by "delete_snapshot" :: held 1.578s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:22 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-08898017-f92b-4ebf-9f64-1056fb80b523 tempest-ProjectMemberTests-1858363890 None] Created reservations ['cbc1c65a-1c1b-43e3-a29a-8501da7f744d', 'dd7b6c7b-4ec9-4d29-9bbf-ac67bb9257ee', 'a0777e9c-7134-4838-bd2a-fa6fa8cbcecf', 'ce69334a-b7f7-4632-a721-b35138a80ead'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:23 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-08898017-f92b-4ebf-9f64-1056fb80b523 tempest-ProjectMemberTests-1858363890 None] Delete snapshot completed successfully. Sep 07 14:05:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-08898017-f92b-4ebf-9f64-1056fb80b523 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-aca56584-a990-45c7-ab66-35fd1854bcb0-delete_snapshot" released by "delete_snapshot" :: held 1.746s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c4c9103a-48c5-43a0-95d3-0d751cb85aca tempest-ProjectReaderTests-2123950541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c4c9103a-48c5-43a0-95d3-0d751cb85aca tempest-ProjectReaderTests-2123950541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:23 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-c4c9103a-48c5-43a0-95d3-0d751cb85aca tempest-ProjectReaderTests-2123950541 None] Creating offline snapshot 7c66172c-c07c-4558-9d2b-ffdc5684f3a2 of volume aa9e05d2-149d-479e-b5ee-09f99f86b656 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:05:23 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[76217aab-383d-48de-9969-9c90a0529053]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c4c9103a-48c5-43a0-95d3-0d751cb85aca tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:23 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656 Sep 07 14:05:23 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-821e7599-8889-450e-8a34-9989b47c853c tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-095048c8-2399-45b8-ab28-b7be08c348d5-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:23 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-07e14a3b-2059-4472-8e16-e72a9581e775 tempest-ProjectAdminTests-996149714 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5802955627441, 'free_capacity_gb': 1773.5802955627441, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87571) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 14:05:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-821e7599-8889-450e-8a34-9989b47c853c tempest-ProjectMemberTests-1858363890 None] Lock "cinder-095048c8-2399-45b8-ab28-b7be08c348d5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-821e7599-8889-450e-8a34-9989b47c853c tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-095048c8-2399-45b8-ab28-b7be08c348d5" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:23 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-821e7599-8889-450e-8a34-9989b47c853c tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-095048c8-2399-45b8-ab28-b7be08c348d5" acquired by "delete_volume" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:23 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be99ec6-56f8-446f-a324-e101324395d7]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-821e7599-8889-450e-8a34-9989b47c853c tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:23 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c4c9103a-48c5-43a0-95d3-0d751cb85aca tempest-ProjectReaderTests-2123950541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656" returned: 0 in 0.432s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:23 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c4c9103a-48c5-43a0-95d3-0d751cb85aca tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.7c66172c-c07c-4558-9d2b-ffdc5684f3a2 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:23 devstack sudo[108738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.7c66172c-c07c-4558-9d2b-ffdc5684f3a2 1G Sep 07 14:05:23 devstack sudo[108738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:23 devstack sudo[108737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5 Sep 07 14:05:23 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:24 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-821e7599-8889-450e-8a34-9989b47c853c tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5" returned: 0 in 0.419s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-821e7599-8889-450e-8a34-9989b47c853c tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:24 devstack sudo[108738]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c4c9103a-48c5-43a0-95d3-0d751cb85aca tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.7c66172c-c07c-4558-9d2b-ffdc5684f3a2 1G" returned: 0 in 0.440s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c4c9103a-48c5-43a0-95d3-0d751cb85aca tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa9e05d2-149d-479e-b5ee-09f99f86b656 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.7c66172c-c07c-4558-9d2b-ffdc5684f3a2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:24 devstack sudo[108747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5 Sep 07 14:05:24 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:24 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa9e05d2-149d-479e-b5ee-09f99f86b656 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.7c66172c-c07c-4558-9d2b-ffdc5684f3a2 Sep 07 14:05:24 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:24 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-821e7599-8889-450e-8a34-9989b47c853c tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-095048c8-2399-45b8-ab28-b7be08c348d5" returned: 0 in 0.269s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:24 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-821e7599-8889-450e-8a34-9989b47c853c tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-095048c8-2399-45b8-ab28-b7be08c348d5" released by "delete_volume" :: held 0.756s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:24 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:24 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-821e7599-8889-450e-8a34-9989b47c853c tempest-ProjectMemberTests-1858363890 None] Created reservations ['7b77fb46-38c2-424e-a04d-6cf10fbe1ef2', '14f1127b-bee1-4f48-b9ed-1ad3555e5415', '208917dc-6d52-445e-8c9f-f8fd9d75bb28', 'f664457d-ed4b-44b9-a57a-58abc0e55f09'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c4c9103a-48c5-43a0-95d3-0d751cb85aca tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa9e05d2-149d-479e-b5ee-09f99f86b656 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.7c66172c-c07c-4558-9d2b-ffdc5684f3a2" returned: 0 in 0.332s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:24 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-c4c9103a-48c5-43a0-95d3-0d751cb85aca tempest-ProjectReaderTests-2123950541 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.7c66172c-c07c-4558-9d2b-ffdc5684f3a2 is being set with open permissions: ugo+rw Sep 07 14:05:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c4c9103a-48c5-43a0-95d3-0d751cb85aca tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.7c66172c-c07c-4558-9d2b-ffdc5684f3a2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:24 devstack sudo[108756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.7c66172c-c07c-4558-9d2b-ffdc5684f3a2 Sep 07 14:05:24 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-821e7599-8889-450e-8a34-9989b47c853c tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-821e7599-8889-450e-8a34-9989b47c853c tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-821e7599-8889-450e-8a34-9989b47c853c tempest-ProjectMemberTests-1858363890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:24 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-821e7599-8889-450e-8a34-9989b47c853c tempest-ProjectMemberTests-1858363890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-821e7599-8889-450e-8a34-9989b47c853c tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-821e7599-8889-450e-8a34-9989b47c853c tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:24 devstack sudo[108758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:05:24 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:24 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c4c9103a-48c5-43a0-95d3-0d751cb85aca tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.7c66172c-c07c-4558-9d2b-ffdc5684f3a2" returned: 0 in 0.345s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c4c9103a-48c5-43a0-95d3-0d751cb85aca tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:24 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:24 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-821e7599-8889-450e-8a34-9989b47c853c tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.296s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:24 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-821e7599-8889-450e-8a34-9989b47c853c tempest-ProjectMemberTests-1858363890 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:24 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.info Sep 07 14:05:24 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:24 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-821e7599-8889-450e-8a34-9989b47c853c tempest-ProjectMemberTests-1858363890 None] Deleted volume successfully. Sep 07 14:05:24 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-821e7599-8889-450e-8a34-9989b47c853c tempest-ProjectMemberTests-1858363890 None] Lock "cinder-095048c8-2399-45b8-ab28-b7be08c348d5-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:25 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c4c9103a-48c5-43a0-95d3-0d751cb85aca tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.info" returned: 0 in 0.299s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:25 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-c4c9103a-48c5-43a0-95d3-0d751cb85aca tempest-ProjectReaderTests-2123950541 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.info is being set with open permissions: ugo+rw Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c4c9103a-48c5-43a0-95d3-0d751cb85aca tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:25 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.info Sep 07 14:05:25 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Flow 'volume_create_manager' (6604cb2d-4294-4cc1-9ca2-7683d3c03141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4172b5f7-1e7f-46e0-bc6c-b86310c6e549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4172b5f7-1e7f-46e0-bc6c-b86310c6e549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1300481958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18d0a3c-bbf6-457c-9c7c-b4cad0eed912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8fd9674bb249b899d5c69373880941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:25Z,use_quota=True,user_id='30c462f1a0094053b9f39392ba6e3442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ee96d2-7b60-4766-b7f1-91e39d74d645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ee96d2-7b60-4766-b7f1-91e39d74d645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249cfb02-9389-43d4-a9a4-d0a9a9894cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249cfb02-9389-43d4-a9a4-d0a9a9894cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd18d0a3c-bbf6-457c-9c7c-b4cad0eed912', 'volume_name': 'volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cef3ac7-008d-4a1e-9e0b-f4e762fa028f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cef3ac7-008d-4a1e-9e0b-f4e762fa028f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78bae85-b33a-4ca3-a36f-dea4f178e957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:25 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Volume d18d0a3c-bbf6-457c-9c7c-b4cad0eed912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912', 'volume_size': 1} Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:25 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c4c9103a-48c5-43a0-95d3-0d751cb85aca tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.info" returned: 0 in 0.303s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c4c9103a-48c5-43a0-95d3-0d751cb85aca tempest-ProjectReaderTests-2123950541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.253s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.067s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1300481958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18d0a3c-bbf6-457c-9c7c-b4cad0eed912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8fd9674bb249b899d5c69373880941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:25Z,use_quota=True,user_id='30c462f1a0094053b9f39392ba6e3442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Creating volume d18d0a3c-bbf6-457c-9c7c-b4cad0eed912 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:25 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:25 devstack sudo[108768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912 1073741824 Sep 07 14:05:25 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:25 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c4c9103a-48c5-43a0-95d3-0d751cb85aca tempest-ProjectReaderTests-2123950541 None] Create snapshot completed successfully Sep 07 14:05:25 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912 1073741824" returned: 0 in 0.459s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:25 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:25 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912 Sep 07 14:05:25 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:26 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912" returned: 0 in 0.274s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:26 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:26 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78bae85-b33a-4ca3-a36f-dea4f178e957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:26 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab356ae8-c48c-4eda-8254-e669bb789ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:26 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Volume volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912 (d18d0a3c-bbf6-457c-9c7c-b4cad0eed912): created successfully Sep 07 14:05:26 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab356ae8-c48c-4eda-8254-e669bb789ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:26 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Flow 'volume_create_manager' (6604cb2d-4294-4cc1-9ca2-7683d3c03141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:26 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-1f7e5968-17e5-4a81-9564-b08430fb13b7 tempest-ProjectMemberTests-1858363890 None] Created volume successfully. Sep 07 14:05:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dea36c28-5282-48b8-9447-8e835f1404a6 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-7c66172c-c07c-4558-9d2b-ffdc5684f3a2-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dea36c28-5282-48b8-9447-8e835f1404a6 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-7c66172c-c07c-4558-9d2b-ffdc5684f3a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dea36c28-5282-48b8-9447-8e835f1404a6 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-quobyte-aa9e05d2-149d-479e-b5ee-09f99f86b656" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dea36c28-5282-48b8-9447-8e835f1404a6 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-aa9e05d2-149d-479e-b5ee-09f99f86b656" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dea36c28-5282-48b8-9447-8e835f1404a6 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-quobyte-7c66172c-c07c-4558-9d2b-ffdc5684f3a2" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:26 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dea36c28-5282-48b8-9447-8e835f1404a6 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-7c66172c-c07c-4558-9d2b-ffdc5684f3a2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:26 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-dea36c28-5282-48b8-9447-8e835f1404a6 tempest-ProjectReaderTests-2123950541 None] Deleting offline snapshot 7c66172c-c07c-4558-9d2b-ffdc5684f3a2 of volume aa9e05d2-149d-479e-b5ee-09f99f86b656 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:05:26 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-dea36c28-5282-48b8-9447-8e835f1404a6 tempest-ProjectReaderTests-2123950541 None] snapshot_file for this snap is: volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.7c66172c-c07c-4558-9d2b-ffdc5684f3a2 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:05:26 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cf8f90-40e8-433b-a8e2-fe5fcdd36dee]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dea36c28-5282-48b8-9447-8e835f1404a6 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.7c66172c-c07c-4558-9d2b-ffdc5684f3a2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:26 devstack sudo[108777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.7c66172c-c07c-4558-9d2b-ffdc5684f3a2 Sep 07 14:05:26 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:26 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dea36c28-5282-48b8-9447-8e835f1404a6 tempest-ProjectReaderTests-2123950541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.7c66172c-c07c-4558-9d2b-ffdc5684f3a2" returned: 0 in 0.412s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:26 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-dea36c28-5282-48b8-9447-8e835f1404a6 tempest-ProjectReaderTests-2123950541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa9e05d2-149d-479e-b5ee-09f99f86b656(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:05:26 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddeea11-c1d9-450b-99e3-9a9de71a63e5]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:26 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dea36c28-5282-48b8-9447-8e835f1404a6 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:26 devstack sudo[108783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656 Sep 07 14:05:26 devstack sudo[108783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:27 devstack sudo[108783]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dea36c28-5282-48b8-9447-8e835f1404a6 tempest-ProjectReaderTests-2123950541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656" returned: 0 in 0.397s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dea36c28-5282-48b8-9447-8e835f1404a6 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.7c66172c-c07c-4558-9d2b-ffdc5684f3a2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:27 devstack sudo[108788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.7c66172c-c07c-4558-9d2b-ffdc5684f3a2 Sep 07 14:05:27 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b80308d9-a12c-4efe-a3bb-16aae8ecee5a tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b80308d9-a12c-4efe-a3bb-16aae8ecee5a tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:27 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-b80308d9-a12c-4efe-a3bb-16aae8ecee5a tempest-ProjectMemberTests-1858363890 None] Creating offline snapshot b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b of volume d18d0a3c-bbf6-457c-9c7c-b4cad0eed912 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:05:27 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1436bf41-2bb9-4383-b17c-cf13f3f5e84d]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b80308d9-a12c-4efe-a3bb-16aae8ecee5a tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:27 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912 Sep 07 14:05:27 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:27 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dea36c28-5282-48b8-9447-8e835f1404a6 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.7c66172c-c07c-4558-9d2b-ffdc5684f3a2" returned: 0 in 0.452s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dea36c28-5282-48b8-9447-8e835f1404a6 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.7c66172c-c07c-4558-9d2b-ffdc5684f3a2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:27 devstack sudo[108795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.7c66172c-c07c-4558-9d2b-ffdc5684f3a2 Sep 07 14:05:27 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:27 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:27 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-dea36c28-5282-48b8-9447-8e835f1404a6 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656.7c66172c-c07c-4558-9d2b-ffdc5684f3a2" returned: 0 in 0.267s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:27 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b80308d9-a12c-4efe-a3bb-16aae8ecee5a tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912" returned: 0 in 0.464s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b80308d9-a12c-4efe-a3bb-16aae8ecee5a tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dea36c28-5282-48b8-9447-8e835f1404a6 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-7c66172c-c07c-4558-9d2b-ffdc5684f3a2" released by "_delete_snapshot" :: held 1.644s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dea36c28-5282-48b8-9447-8e835f1404a6 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-aa9e05d2-149d-479e-b5ee-09f99f86b656" released by "delete_snapshot" :: held 1.673s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:28 devstack sudo[108803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b 1G Sep 07 14:05:28 devstack sudo[108803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-dea36c28-5282-48b8-9447-8e835f1404a6 tempest-ProjectReaderTests-2123950541 None] Created reservations ['56bc86bf-d147-41e9-a1d5-384f998fe2e6', '270d3d19-6dd5-4e23-8cbb-68abd480bef3', '75957d7c-14c5-42d3-aed9-f0a7023a0228', 'a5538ed0-da79-462d-93bb-7de33ab2ce9d'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:28 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-dea36c28-5282-48b8-9447-8e835f1404a6 tempest-ProjectReaderTests-2123950541 None] Delete snapshot completed successfully. Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-dea36c28-5282-48b8-9447-8e835f1404a6 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-7c66172c-c07c-4558-9d2b-ffdc5684f3a2-delete_snapshot" released by "delete_snapshot" :: held 1.829s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:28 devstack sudo[108808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:05:28 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:28 devstack sudo[108803]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b80308d9-a12c-4efe-a3bb-16aae8ecee5a tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b 1G" returned: 0 in 0.465s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b80308d9-a12c-4efe-a3bb-16aae8ecee5a tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:28 devstack sudo[108811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b Sep 07 14:05:28 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-24e19b99-bb98-417b-b122-2b8462b3c7f1 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-aa9e05d2-149d-479e-b5ee-09f99f86b656-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-24e19b99-bb98-417b-b122-2b8462b3c7f1 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-aa9e05d2-149d-479e-b5ee-09f99f86b656-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:28 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-24e19b99-bb98-417b-b122-2b8462b3c7f1 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "cinder-quobyte-aa9e05d2-149d-479e-b5ee-09f99f86b656" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.322s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager._thread_info {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread count: 28 {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread info: [<_MainThread(MainThread, started 132147689414784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-24e19b99-bb98-417b-b122-2b8462b3c7f1 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-aa9e05d2-149d-479e-b5ee-09f99f86b656" acquired by "delete_volume" :: waited 0.030s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e15349a-9d7c-4900-a92a-b411711353e3]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-24e19b99-bb98-417b-b122-2b8462b3c7f1 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:28 devstack sudo[108814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656 Sep 07 14:05:28 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:28 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b80308d9-a12c-4efe-a3bb-16aae8ecee5a tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b" returned: 0 in 0.398s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:28 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-b80308d9-a12c-4efe-a3bb-16aae8ecee5a tempest-ProjectMemberTests-1858363890 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b is being set with open permissions: ugo+rw Sep 07 14:05:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b80308d9-a12c-4efe-a3bb-16aae8ecee5a tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:28 devstack sudo[108819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b Sep 07 14:05:28 devstack sudo[108819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:29 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-24e19b99-bb98-417b-b122-2b8462b3c7f1 tempest-ProjectReaderTests-2123950541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656" returned: 0 in 0.447s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:29 devstack sudo[108819]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-24e19b99-bb98-417b-b122-2b8462b3c7f1 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b80308d9-a12c-4efe-a3bb-16aae8ecee5a tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b" returned: 0 in 0.311s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:29 devstack sudo[108825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656 Sep 07 14:05:29 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b80308d9-a12c-4efe-a3bb-16aae8ecee5a tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:29 devstack sudo[108827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.info Sep 07 14:05:29 devstack sudo[108827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:29 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-24e19b99-bb98-417b-b122-2b8462b3c7f1 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-aa9e05d2-149d-479e-b5ee-09f99f86b656" returned: 0 in 0.305s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:29 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-24e19b99-bb98-417b-b122-2b8462b3c7f1 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-quobyte-aa9e05d2-149d-479e-b5ee-09f99f86b656" released by "delete_volume" :: held 0.828s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:29 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-24e19b99-bb98-417b-b122-2b8462b3c7f1 tempest-ProjectReaderTests-2123950541 None] Created reservations ['6ac4164d-df98-4ed5-bfe7-3ed7ea9d4e95', '2baba2c8-ed9e-4491-b619-1f9b41123e7d', '8696619b-44b2-4b88-a73a-d254ff1c5876', '5fbb1a45-82ba-4559-a58f-66e5c8d54f8b'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:29 devstack sudo[108827]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b80308d9-a12c-4efe-a3bb-16aae8ecee5a tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.info" returned: 0 in 0.354s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:29 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-b80308d9-a12c-4efe-a3bb-16aae8ecee5a tempest-ProjectMemberTests-1858363890 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.info is being set with open permissions: ugo+rw Sep 07 14:05:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b80308d9-a12c-4efe-a3bb-16aae8ecee5a tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:29 devstack sudo[108831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.info Sep 07 14:05:29 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-24e19b99-bb98-417b-b122-2b8462b3c7f1 tempest-ProjectReaderTests-2123950541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-24e19b99-bb98-417b-b122-2b8462b3c7f1 tempest-ProjectReaderTests-2123950541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-24e19b99-bb98-417b-b122-2b8462b3c7f1 tempest-ProjectReaderTests-2123950541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:29 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-24e19b99-bb98-417b-b122-2b8462b3c7f1 tempest-ProjectReaderTests-2123950541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-24e19b99-bb98-417b-b122-2b8462b3c7f1 tempest-ProjectReaderTests-2123950541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-24e19b99-bb98-417b-b122-2b8462b3c7f1 tempest-ProjectReaderTests-2123950541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:29 devstack sudo[108833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:05:29 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:29 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-b80308d9-a12c-4efe-a3bb-16aae8ecee5a tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.info" returned: 0 in 0.365s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:29 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-b80308d9-a12c-4efe-a3bb-16aae8ecee5a tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.473s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:30 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-b80308d9-a12c-4efe-a3bb-16aae8ecee5a tempest-ProjectMemberTests-1858363890 None] Create snapshot completed successfully Sep 07 14:05:30 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-24e19b99-bb98-417b-b122-2b8462b3c7f1 tempest-ProjectReaderTests-2123950541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.350s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:30 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-24e19b99-bb98-417b-b122-2b8462b3c7f1 tempest-ProjectReaderTests-2123950541 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:30 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-24e19b99-bb98-417b-b122-2b8462b3c7f1 tempest-ProjectReaderTests-2123950541 None] Deleted volume successfully. Sep 07 14:05:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-24e19b99-bb98-417b-b122-2b8462b3c7f1 tempest-ProjectReaderTests-2123950541 None] Lock "cinder-aa9e05d2-149d-479e-b5ee-09f99f86b656-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c26606e2-0142-4338-9659-95836776b487 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c26606e2-0142-4338-9659-95836776b487 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c26606e2-0142-4338-9659-95836776b487 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c26606e2-0142-4338-9659-95836776b487 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c26606e2-0142-4338-9659-95836776b487 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:30 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c26606e2-0142-4338-9659-95836776b487 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b" acquired by "_delete_snapshot" :: waited 0.067s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-c26606e2-0142-4338-9659-95836776b487 tempest-ProjectMemberTests-1858363890 None] Deleting offline snapshot b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b of volume d18d0a3c-bbf6-457c-9c7c-b4cad0eed912 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:05:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-c26606e2-0142-4338-9659-95836776b487 tempest-ProjectMemberTests-1858363890 None] snapshot_file for this snap is: volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:05:30 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aeb4af8-ace2-4f35-8a94-db896b1db966]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c26606e2-0142-4338-9659-95836776b487 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:30 devstack sudo[108837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b Sep 07 14:05:30 devstack sudo[108837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:31 devstack sudo[108837]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c26606e2-0142-4338-9659-95836776b487 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b" returned: 0 in 0.427s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-c26606e2-0142-4338-9659-95836776b487 tempest-ProjectMemberTests-1858363890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:05:31 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e47b535-7794-42bc-874a-7ae8a2145ea9]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c26606e2-0142-4338-9659-95836776b487 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:31 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912 Sep 07 14:05:31 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:31 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c26606e2-0142-4338-9659-95836776b487 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912" returned: 0 in 0.419s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c26606e2-0142-4338-9659-95836776b487 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:31 devstack sudo[108847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b Sep 07 14:05:31 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:32 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c26606e2-0142-4338-9659-95836776b487 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b" returned: 0 in 0.391s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c26606e2-0142-4338-9659-95836776b487 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:32 devstack sudo[108853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b Sep 07 14:05:32 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:32 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c26606e2-0142-4338-9659-95836776b487 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912.b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b" returned: 0 in 0.255s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c26606e2-0142-4338-9659-95836776b487 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b" released by "_delete_snapshot" :: held 1.616s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c26606e2-0142-4338-9659-95836776b487 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912" released by "delete_snapshot" :: held 1.690s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:32 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-c26606e2-0142-4338-9659-95836776b487 tempest-ProjectMemberTests-1858363890 None] Created reservations ['b17a8581-dbd5-4430-90c2-40059eef4d4f', '082a32b5-b23a-4760-8ad1-c8ec364c0796', 'a0e6809e-111c-4840-855f-7c33466c3712', '78e3b49a-151c-4e17-b030-14fc1a530529'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:32 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c26606e2-0142-4338-9659-95836776b487 tempest-ProjectMemberTests-1858363890 None] Delete snapshot completed successfully. Sep 07 14:05:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c26606e2-0142-4338-9659-95836776b487 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-b40d6d47-1fd6-458c-b5d2-e8a8ba7dac0b-delete_snapshot" released by "delete_snapshot" :: held 1.847s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6f4ab19f-e0aa-4d96-9ab7-df1b18d87ed1 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6f4ab19f-e0aa-4d96-9ab7-df1b18d87ed1 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6f4ab19f-e0aa-4d96-9ab7-df1b18d87ed1 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:32 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6f4ab19f-e0aa-4d96-9ab7-df1b18d87ed1 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912" acquired by "delete_volume" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:33 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd27d53-67f0-4183-ae99-94c95246cc89]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6f4ab19f-e0aa-4d96-9ab7-df1b18d87ed1 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:33 devstack sudo[108856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912 Sep 07 14:05:33 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:33 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6f4ab19f-e0aa-4d96-9ab7-df1b18d87ed1 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912" returned: 0 in 0.435s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6f4ab19f-e0aa-4d96-9ab7-df1b18d87ed1 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:33 devstack sudo[108862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912 Sep 07 14:05:33 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:33 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6f4ab19f-e0aa-4d96-9ab7-df1b18d87ed1 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912" returned: 0 in 0.258s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6f4ab19f-e0aa-4d96-9ab7-df1b18d87ed1 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912" released by "delete_volume" :: held 0.780s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:33 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-6f4ab19f-e0aa-4d96-9ab7-df1b18d87ed1 tempest-ProjectMemberTests-1858363890 None] Created reservations ['46727d15-95b5-40b8-a98e-067fac408635', 'fd98c488-8cd1-46d9-9748-cbb20e348af5', 'e1ed26a7-1927-4805-a302-43963beddaac', '9f095788-9e1f-41f5-896e-b6c93d127a9d'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6f4ab19f-e0aa-4d96-9ab7-df1b18d87ed1 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6f4ab19f-e0aa-4d96-9ab7-df1b18d87ed1 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-6f4ab19f-e0aa-4d96-9ab7-df1b18d87ed1 tempest-ProjectMemberTests-1858363890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-6f4ab19f-e0aa-4d96-9ab7-df1b18d87ed1 tempest-ProjectMemberTests-1858363890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6f4ab19f-e0aa-4d96-9ab7-df1b18d87ed1 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6f4ab19f-e0aa-4d96-9ab7-df1b18d87ed1 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:33 devstack sudo[108865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:05:33 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:34 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6f4ab19f-e0aa-4d96-9ab7-df1b18d87ed1 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.252s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-6f4ab19f-e0aa-4d96-9ab7-df1b18d87ed1 tempest-ProjectMemberTests-1858363890 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:34 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-6f4ab19f-e0aa-4d96-9ab7-df1b18d87ed1 tempest-ProjectMemberTests-1858363890 None] Deleted volume successfully. Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6f4ab19f-e0aa-4d96-9ab7-df1b18d87ed1 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-d18d0a3c-bbf6-457c-9c7c-b4cad0eed912-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Flow 'volume_create_manager' (92d82fba-71eb-41b9-a952-bc34e6e326fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f049ef-b383-4418-b157-bd731b9538a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f049ef-b383-4418-b157-bd731b9538a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-348199290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8fd9674bb249b899d5c69373880941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:35Z,use_quota=True,user_id='30c462f1a0094053b9f39392ba6e3442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a264620a-6fb4-4ec6-b49b-a9d344e3cdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a264620a-6fb4-4ec6-b49b-a9d344e3cdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294589ee-40cf-4762-b010-95ef58d001ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294589ee-40cf-4762-b010-95ef58d001ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd', 'volume_name': 'volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ea337d-bcff-45ee-aa70-d8d988a50312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ea337d-bcff-45ee-aa70-d8d988a50312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c33481f-0f9e-44ca-a5e8-27af4b03df69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:34 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Volume 0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd', 'volume_size': 1} Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-348199290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8fd9674bb249b899d5c69373880941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:35Z,use_quota=True,user_id='30c462f1a0094053b9f39392ba6e3442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Creating volume 0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:34 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:05:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:34 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd 1073741824 Sep 07 14:05:34 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:35 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd 1073741824" returned: 0 in 0.524s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:35 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd Sep 07 14:05:35 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:35 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd" returned: 0 in 0.245s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:35 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:35 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:35 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c33481f-0f9e-44ca-a5e8-27af4b03df69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:35 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7cfca4-7a97-4fe1-94af-9187795dfa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:35 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Volume volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd (0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd): created successfully Sep 07 14:05:35 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7cfca4-7a97-4fe1-94af-9187795dfa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:35 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Flow 'volume_create_manager' (92d82fba-71eb-41b9-a952-bc34e6e326fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:35 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-546a2ca4-b786-4001-bf9b-b0c8af9b27cc tempest-ProjectMemberTests-1858363890 None] Created volume successfully. Sep 07 14:05:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8638e67b-490d-434d-b4a8-195eece360b3 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8638e67b-490d-434d-b4a8-195eece360b3 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:36 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-8638e67b-490d-434d-b4a8-195eece360b3 tempest-ProjectMemberTests-1858363890 None] Creating offline snapshot 33063a09-fdb9-48ba-abd2-5f0b5d7a0a11 of volume 0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:05:36 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5205b58-35c8-4320-92e3-b042349a8e52]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:36 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8638e67b-490d-434d-b4a8-195eece360b3 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:37 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd Sep 07 14:05:37 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:37 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8638e67b-490d-434d-b4a8-195eece360b3 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd" returned: 0 in 0.401s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8638e67b-490d-434d-b4a8-195eece360b3 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.33063a09-fdb9-48ba-abd2-5f0b5d7a0a11 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:37 devstack sudo[108885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.33063a09-fdb9-48ba-abd2-5f0b5d7a0a11 1G Sep 07 14:05:37 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:37 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8638e67b-490d-434d-b4a8-195eece360b3 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.33063a09-fdb9-48ba-abd2-5f0b5d7a0a11 1G" returned: 0 in 0.422s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:37 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8638e67b-490d-434d-b4a8-195eece360b3 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.33063a09-fdb9-48ba-abd2-5f0b5d7a0a11 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:37 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.33063a09-fdb9-48ba-abd2-5f0b5d7a0a11 Sep 07 14:05:37 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:38 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8638e67b-490d-434d-b4a8-195eece360b3 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.33063a09-fdb9-48ba-abd2-5f0b5d7a0a11" returned: 0 in 0.307s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:38 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-8638e67b-490d-434d-b4a8-195eece360b3 tempest-ProjectMemberTests-1858363890 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.33063a09-fdb9-48ba-abd2-5f0b5d7a0a11 is being set with open permissions: ugo+rw Sep 07 14:05:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8638e67b-490d-434d-b4a8-195eece360b3 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.33063a09-fdb9-48ba-abd2-5f0b5d7a0a11 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:38 devstack sudo[108897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.33063a09-fdb9-48ba-abd2-5f0b5d7a0a11 Sep 07 14:05:38 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:38 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8638e67b-490d-434d-b4a8-195eece360b3 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.33063a09-fdb9-48ba-abd2-5f0b5d7a0a11" returned: 0 in 0.243s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8638e67b-490d-434d-b4a8-195eece360b3 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:38 devstack sudo[108900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.info Sep 07 14:05:38 devstack sudo[108900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:38 devstack sudo[108900]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8638e67b-490d-434d-b4a8-195eece360b3 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.info" returned: 0 in 0.253s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:38 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-8638e67b-490d-434d-b4a8-195eece360b3 tempest-ProjectMemberTests-1858363890 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.info is being set with open permissions: ugo+rw Sep 07 14:05:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8638e67b-490d-434d-b4a8-195eece360b3 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:38 devstack sudo[108903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.info Sep 07 14:05:38 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:38 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8638e67b-490d-434d-b4a8-195eece360b3 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.info" returned: 0 in 0.250s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8638e67b-490d-434d-b4a8-195eece360b3 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.962s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:38 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-8638e67b-490d-434d-b4a8-195eece360b3 tempest-ProjectMemberTests-1858363890 None] Create snapshot completed successfully Sep 07 14:05:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-af658761-e3df-4e6d-9ff3-cb505267d04f tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-33063a09-fdb9-48ba-abd2-5f0b5d7a0a11-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-af658761-e3df-4e6d-9ff3-cb505267d04f tempest-ProjectMemberTests-1858363890 None] Lock "cinder-33063a09-fdb9-48ba-abd2-5f0b5d7a0a11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-af658761-e3df-4e6d-9ff3-cb505267d04f tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-af658761-e3df-4e6d-9ff3-cb505267d04f tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-af658761-e3df-4e6d-9ff3-cb505267d04f tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-33063a09-fdb9-48ba-abd2-5f0b5d7a0a11" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-af658761-e3df-4e6d-9ff3-cb505267d04f tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-33063a09-fdb9-48ba-abd2-5f0b5d7a0a11" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-af658761-e3df-4e6d-9ff3-cb505267d04f tempest-ProjectMemberTests-1858363890 None] Deleting offline snapshot 33063a09-fdb9-48ba-abd2-5f0b5d7a0a11 of volume 0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:05:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-af658761-e3df-4e6d-9ff3-cb505267d04f tempest-ProjectMemberTests-1858363890 None] snapshot_file for this snap is: volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.33063a09-fdb9-48ba-abd2-5f0b5d7a0a11 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:05:39 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e34dc36-c8e5-4f4b-bef7-df2885105d07]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-af658761-e3df-4e6d-9ff3-cb505267d04f tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.33063a09-fdb9-48ba-abd2-5f0b5d7a0a11 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:39 devstack sudo[108906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.33063a09-fdb9-48ba-abd2-5f0b5d7a0a11 Sep 07 14:05:39 devstack sudo[108906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:39 devstack sudo[108906]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-af658761-e3df-4e6d-9ff3-cb505267d04f tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.33063a09-fdb9-48ba-abd2-5f0b5d7a0a11" returned: 0 in 0.381s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-af658761-e3df-4e6d-9ff3-cb505267d04f tempest-ProjectMemberTests-1858363890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:05:39 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3758d0-198d-4b6a-b7ee-f3036df7b850]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-af658761-e3df-4e6d-9ff3-cb505267d04f tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:39 devstack sudo[108911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd Sep 07 14:05:39 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:39 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-af658761-e3df-4e6d-9ff3-cb505267d04f tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd" returned: 0 in 0.392s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-af658761-e3df-4e6d-9ff3-cb505267d04f tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.33063a09-fdb9-48ba-abd2-5f0b5d7a0a11 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:39 devstack sudo[108916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.33063a09-fdb9-48ba-abd2-5f0b5d7a0a11 Sep 07 14:05:39 devstack sudo[108916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:40 devstack sudo[108916]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-af658761-e3df-4e6d-9ff3-cb505267d04f tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.33063a09-fdb9-48ba-abd2-5f0b5d7a0a11" returned: 0 in 0.402s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-af658761-e3df-4e6d-9ff3-cb505267d04f tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.33063a09-fdb9-48ba-abd2-5f0b5d7a0a11 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:40 devstack sudo[108922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.33063a09-fdb9-48ba-abd2-5f0b5d7a0a11 Sep 07 14:05:40 devstack sudo[108922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:40 devstack sudo[108922]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-af658761-e3df-4e6d-9ff3-cb505267d04f tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd.33063a09-fdb9-48ba-abd2-5f0b5d7a0a11" returned: 0 in 0.314s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:40 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-af658761-e3df-4e6d-9ff3-cb505267d04f tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-33063a09-fdb9-48ba-abd2-5f0b5d7a0a11" released by "_delete_snapshot" :: held 1.607s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:40 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-af658761-e3df-4e6d-9ff3-cb505267d04f tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd" released by "delete_snapshot" :: held 1.633s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:40 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-af658761-e3df-4e6d-9ff3-cb505267d04f tempest-ProjectMemberTests-1858363890 None] Created reservations ['8990855d-9275-4386-a747-8462137ff555', '0452d5ba-577c-429c-833c-ac90e46ee894', 'ab673245-c466-41f7-92c9-c050e39033a2', '3f7a21a7-bc2a-4a87-a499-7068596bfc34'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:40 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-af658761-e3df-4e6d-9ff3-cb505267d04f tempest-ProjectMemberTests-1858363890 None] Delete snapshot completed successfully. Sep 07 14:05:40 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-af658761-e3df-4e6d-9ff3-cb505267d04f tempest-ProjectMemberTests-1858363890 None] Lock "cinder-33063a09-fdb9-48ba-abd2-5f0b5d7a0a11-delete_snapshot" released by "delete_snapshot" :: held 1.794s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6471a75d-55e5-4749-85f5-693ea1dbcebe tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6471a75d-55e5-4749-85f5-693ea1dbcebe tempest-ProjectMemberTests-1858363890 None] Lock "cinder-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6471a75d-55e5-4749-85f5-693ea1dbcebe tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6471a75d-55e5-4749-85f5-693ea1dbcebe tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd" acquired by "delete_volume" :: waited 0.026s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[763f2694-4c63-4a88-97b2-b563b95932c1]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6471a75d-55e5-4749-85f5-693ea1dbcebe tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:41 devstack sudo[108925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd Sep 07 14:05:41 devstack sudo[108925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Flow 'volume_create_manager' (444434d8-f311-464b-9e7a-e77b3da58582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b055cc4-0533-4f6f-9376-60b02fad45c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b055cc4-0533-4f6f-9376-60b02fad45c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1175688282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa34d7ceae02472188b6a9271cfea34a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:41Z,use_quota=True,user_id='7c2ad8c11d39475ba1fbca45e4d7414e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33319c6c-fc43-4760-bba2-d187b848c857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33319c6c-fc43-4760-bba2-d187b848c857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec124a7-f6d6-452f-9e33-711fcdcab689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec124a7-f6d6-452f-9e33-711fcdcab689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9', 'volume_name': 'volume-fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa92594e-092d-4390-9eeb-ed7384c25604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa92594e-092d-4390-9eeb-ed7384c25604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5342fc6a-8810-40a2-b016-b884ff7a3d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:41 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Volume fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9', 'volume_size': 1} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1175688282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa34d7ceae02472188b6a9271cfea34a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:41Z,use_quota=True,user_id='7c2ad8c11d39475ba1fbca45e4d7414e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Creating volume fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:41 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:41 devstack sudo[108929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9 1073741824 Sep 07 14:05:41 devstack sudo[108929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:41 devstack sudo[108925]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6471a75d-55e5-4749-85f5-693ea1dbcebe tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd" returned: 0 in 0.369s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6471a75d-55e5-4749-85f5-693ea1dbcebe tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:41 devstack sudo[108932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd Sep 07 14:05:41 devstack sudo[108932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:41 devstack sudo[108932]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6471a75d-55e5-4749-85f5-693ea1dbcebe tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd" returned: 0 in 0.249s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:41 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6471a75d-55e5-4749-85f5-693ea1dbcebe tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd" released by "delete_volume" :: held 0.698s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-6471a75d-55e5-4749-85f5-693ea1dbcebe tempest-ProjectMemberTests-1858363890 None] Created reservations ['e678e7f9-5652-4076-8d86-f2d7f1bac976', '18ef17fa-aae5-44ac-bfcf-ae5a9a8d36af', 'ec21408c-5a50-4a1a-adc0-ef7959c39ec8', 'ac925645-80c5-4f0c-8f9f-5d5455cc1496'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6471a75d-55e5-4749-85f5-693ea1dbcebe tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6471a75d-55e5-4749-85f5-693ea1dbcebe tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-6471a75d-55e5-4749-85f5-693ea1dbcebe tempest-ProjectMemberTests-1858363890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:42 devstack sudo[108929]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-6471a75d-55e5-4749-85f5-693ea1dbcebe tempest-ProjectMemberTests-1858363890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-6471a75d-55e5-4749-85f5-693ea1dbcebe tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6471a75d-55e5-4749-85f5-693ea1dbcebe tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9 1073741824" returned: 0 in 0.467s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:42 devstack sudo[108939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:05:42 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:42 devstack sudo[108941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9 Sep 07 14:05:42 devstack sudo[108941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:42 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-6471a75d-55e5-4749-85f5-693ea1dbcebe tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.280s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-6471a75d-55e5-4749-85f5-693ea1dbcebe tempest-ProjectMemberTests-1858363890 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:42 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-6471a75d-55e5-4749-85f5-693ea1dbcebe tempest-ProjectMemberTests-1858363890 None] Deleted volume successfully. Sep 07 14:05:42 devstack sudo[108941]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9" returned: 0 in 0.253s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5342fc6a-8810-40a2-b016-b884ff7a3d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c2c78e-0709-47de-9bff-87cbc50635f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-6471a75d-55e5-4749-85f5-693ea1dbcebe tempest-ProjectMemberTests-1858363890 None] Lock "cinder-0e7902fa-eb38-40e3-b27a-c3f6d3cb6bdd-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:42 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Volume volume-fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9 (fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9): created successfully Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c2c78e-0709-47de-9bff-87cbc50635f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Flow 'volume_create_manager' (444434d8-f311-464b-9e7a-e77b3da58582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:42 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c8e7b5ad-cde0-44ee-bd0a-ee28c89712cb tempest-ProjectReaderTests-1200346658 None] Created volume successfully. Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a75a1932-52b4-4f90-b626-505d270bf063 tempest-ProjectReaderTests-1200346658 None] Acquiring lock "cinder-fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a75a1932-52b4-4f90-b626-505d270bf063 tempest-ProjectReaderTests-1200346658 None] Lock "cinder-fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a75a1932-52b4-4f90-b626-505d270bf063 tempest-ProjectReaderTests-1200346658 None] Acquiring lock "cinder-quobyte-fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a75a1932-52b4-4f90-b626-505d270bf063 tempest-ProjectReaderTests-1200346658 None] Lock "cinder-quobyte-fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9" acquired by "delete_volume" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[babfa32e-481b-4d95-beef-14c76b56f46a]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a75a1932-52b4-4f90-b626-505d270bf063 tempest-ProjectReaderTests-1200346658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Flow 'volume_create_manager' (042305e5-c28e-4a64-80d9-7f02ae1b790b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9071e9d5-b5b2-427b-bdfc-970abd5232ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9071e9d5-b5b2-427b-bdfc-970abd5232ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-438915639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58505c5d-b53d-4ca3-82a4-c48b05eea5e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8fd9674bb249b899d5c69373880941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:43Z,use_quota=True,user_id='30c462f1a0094053b9f39392ba6e3442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e72577-33b5-4358-b438-459154ea24a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e72577-33b5-4358-b438-459154ea24a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf85f54-008c-48cf-844a-ab904818b5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf85f54-008c-48cf-844a-ab904818b5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58505c5d-b53d-4ca3-82a4-c48b05eea5e2', 'volume_name': 'volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b5a276-9730-4559-b971-cb675786295b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:42 devstack sudo[108945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9 Sep 07 14:05:42 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b5a276-9730-4559-b971-cb675786295b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:42 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5aa45d3-674d-434d-9436-1fd23f65f510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:42 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Volume 58505c5d-b53d-4ca3-82a4-c48b05eea5e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2', 'volume_size': 1} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-438915639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58505c5d-b53d-4ca3-82a4-c48b05eea5e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8fd9674bb249b899d5c69373880941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:43Z,use_quota=True,user_id='30c462f1a0094053b9f39392ba6e3442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Creating volume 58505c5d-b53d-4ca3-82a4-c48b05eea5e2 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:43 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:43 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2 1073741824 Sep 07 14:05:43 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:43 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a75a1932-52b4-4f90-b626-505d270bf063 tempest-ProjectReaderTests-1200346658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9" returned: 0 in 0.390s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a75a1932-52b4-4f90-b626-505d270bf063 tempest-ProjectReaderTests-1200346658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:43 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9 Sep 07 14:05:43 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:43 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2 1073741824" returned: 0 in 0.418s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:43 devstack sudo[108957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2 Sep 07 14:05:43 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:43 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a75a1932-52b4-4f90-b626-505d270bf063 tempest-ProjectReaderTests-1200346658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9" returned: 0 in 0.279s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a75a1932-52b4-4f90-b626-505d270bf063 tempest-ProjectReaderTests-1200346658 None] Lock "cinder-quobyte-fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9" released by "delete_volume" :: held 0.711s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-a75a1932-52b4-4f90-b626-505d270bf063 tempest-ProjectReaderTests-1200346658 None] Created reservations ['dfba3769-3bf6-4472-b3a0-8c5ba240a26f', '68168dc1-8740-424f-9b9e-313f7a5bef91', '97dda71a-aa8f-493a-bf8e-2cc08b92df4f', 'b57e4bdd-b008-401c-93f1-acfc8ee556fc'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a75a1932-52b4-4f90-b626-505d270bf063 tempest-ProjectReaderTests-1200346658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a75a1932-52b4-4f90-b626-505d270bf063 tempest-ProjectReaderTests-1200346658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a75a1932-52b4-4f90-b626-505d270bf063 tempest-ProjectReaderTests-1200346658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-a75a1932-52b4-4f90-b626-505d270bf063 tempest-ProjectReaderTests-1200346658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-a75a1932-52b4-4f90-b626-505d270bf063 tempest-ProjectReaderTests-1200346658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a75a1932-52b4-4f90-b626-505d270bf063 tempest-ProjectReaderTests-1200346658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:43 devstack sudo[108961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:05:43 devstack sudo[108961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:43 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2" returned: 0 in 0.247s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5aa45d3-674d-434d-9436-1fd23f65f510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e237320-0746-4e0f-b4e5-a60fbaaa1fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:43 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Volume volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2 (58505c5d-b53d-4ca3-82a4-c48b05eea5e2): created successfully Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e237320-0746-4e0f-b4e5-a60fbaaa1fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Flow 'volume_create_manager' (042305e5-c28e-4a64-80d9-7f02ae1b790b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:43 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-677cc046-acb5-46dc-8624-a3e77454f6fa tempest-ProjectMemberTests-1858363890 None] Created volume successfully. Sep 07 14:05:43 devstack sudo[108961]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-a75a1932-52b4-4f90-b626-505d270bf063 tempest-ProjectReaderTests-1200346658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.293s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-a75a1932-52b4-4f90-b626-505d270bf063 tempest-ProjectReaderTests-1200346658 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:43 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-a75a1932-52b4-4f90-b626-505d270bf063 tempest-ProjectReaderTests-1200346658 None] Deleted volume successfully. Sep 07 14:05:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-a75a1932-52b4-4f90-b626-505d270bf063 tempest-ProjectReaderTests-1200346658 None] Lock "cinder-fcd8c6c6-a4b8-4d3f-80ae-034fa4afecd9-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c72fcb77-01b3-4e7b-9be2-80edf1357011 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c72fcb77-01b3-4e7b-9be2-80edf1357011 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:44 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-c72fcb77-01b3-4e7b-9be2-80edf1357011 tempest-ProjectMemberTests-1858363890 None] Creating offline snapshot cab68c0a-592a-42ab-b26c-5604d81964a9 of volume 58505c5d-b53d-4ca3-82a4-c48b05eea5e2 {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:05:44 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9babd7-8f44-4925-aa52-5d08555aee71]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c72fcb77-01b3-4e7b-9be2-80edf1357011 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:44 devstack sudo[108964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2 Sep 07 14:05:44 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:44 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:05:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Flow 'volume_create_manager' (a71573e2-01a1-435c-adb4-767fb5163c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e0e40a-0a48-47aa-b251-cee1883a7b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e0e40a-0a48-47aa-b251-cee1883a7b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657145956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a483da9-4ecd-4be7-ab6b-2852d4391de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa34d7ceae02472188b6a9271cfea34a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:44Z,use_quota=True,user_id='7c2ad8c11d39475ba1fbca45e4d7414e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:44 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4bd50e8-d61a-4715-bbc0-ed96dbff3fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4bd50e8-d61a-4715-bbc0-ed96dbff3fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6969950b-80af-4d3f-bfc1-a0856343fe0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6969950b-80af-4d3f-bfc1-a0856343fe0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a483da9-4ecd-4be7-ab6b-2852d4391de5', 'volume_name': 'volume-7a483da9-4ecd-4be7-ab6b-2852d4391de5', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (610b487f-dc4c-4038-a937-0bc60d2b811b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (610b487f-dc4c-4038-a937-0bc60d2b811b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:44 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a0bbca-3416-467e-baea-537f2b8c10b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:44 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Volume 7a483da9-4ecd-4be7-ab6b-2852d4391de5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a483da9-4ecd-4be7-ab6b-2852d4391de5', 'volume_size': 1} Sep 07 14:05:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c72fcb77-01b3-4e7b-9be2-80edf1357011 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2" returned: 0 in 0.414s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c72fcb77-01b3-4e7b-9be2-80edf1357011 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.cab68c0a-592a-42ab-b26c-5604d81964a9 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:44 devstack sudo[108969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.cab68c0a-592a-42ab-b26c-5604d81964a9 1G Sep 07 14:05:44 devstack sudo[108969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:44 devstack sudo[108969]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c72fcb77-01b3-4e7b-9be2-80edf1357011 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.cab68c0a-592a-42ab-b26c-5604d81964a9 1G" returned: 0 in 0.378s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:44 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c72fcb77-01b3-4e7b-9be2-80edf1357011 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.cab68c0a-592a-42ab-b26c-5604d81964a9 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:44 devstack sudo[108975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.cab68c0a-592a-42ab-b26c-5604d81964a9 Sep 07 14:05:44 devstack sudo[108975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:45 devstack sudo[108975]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c72fcb77-01b3-4e7b-9be2-80edf1357011 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2 -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.cab68c0a-592a-42ab-b26c-5604d81964a9" returned: 0 in 0.285s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:45 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-c72fcb77-01b3-4e7b-9be2-80edf1357011 tempest-ProjectMemberTests-1858363890 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.cab68c0a-592a-42ab-b26c-5604d81964a9 is being set with open permissions: ugo+rw Sep 07 14:05:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c72fcb77-01b3-4e7b-9be2-80edf1357011 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.cab68c0a-592a-42ab-b26c-5604d81964a9 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:45 devstack sudo[108980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.cab68c0a-592a-42ab-b26c-5604d81964a9 Sep 07 14:05:45 devstack sudo[108980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:45 devstack sudo[108980]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c72fcb77-01b3-4e7b-9be2-80edf1357011 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.cab68c0a-592a-42ab-b26c-5604d81964a9" returned: 0 in 0.244s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c72fcb77-01b3-4e7b-9be2-80edf1357011 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:45 devstack sudo[108983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.info Sep 07 14:05:45 devstack sudo[108983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:45 devstack sudo[108983]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c72fcb77-01b3-4e7b-9be2-80edf1357011 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.info" returned: 0 in 0.247s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:45 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-c72fcb77-01b3-4e7b-9be2-80edf1357011 tempest-ProjectMemberTests-1858363890 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.info is being set with open permissions: ugo+rw Sep 07 14:05:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c72fcb77-01b3-4e7b-9be2-80edf1357011 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:45 devstack sudo[108986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.info Sep 07 14:05:45 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:45 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c72fcb77-01b3-4e7b-9be2-80edf1357011 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.info" returned: 0 in 0.249s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c72fcb77-01b3-4e7b-9be2-80edf1357011 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.899s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.451s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:45 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657145956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a483da9-4ecd-4be7-ab6b-2852d4391de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa34d7ceae02472188b6a9271cfea34a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:44Z,use_quota=True,user_id='7c2ad8c11d39475ba1fbca45e4d7414e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:45 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Creating volume 7a483da9-4ecd-4be7-ab6b-2852d4391de5 {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:45 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:45 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:45 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:45 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:05:45 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a483da9-4ecd-4be7-ab6b-2852d4391de5 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:46 devstack sudo[108989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a483da9-4ecd-4be7-ab6b-2852d4391de5 1073741824 Sep 07 14:05:46 devstack sudo[108989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:46 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c72fcb77-01b3-4e7b-9be2-80edf1357011 tempest-ProjectMemberTests-1858363890 None] Create snapshot completed successfully Sep 07 14:05:46 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5b330063-c414-43cb-8951-b8b6325dc7b1 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-cab68c0a-592a-42ab-b26c-5604d81964a9-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:46 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5b330063-c414-43cb-8951-b8b6325dc7b1 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-cab68c0a-592a-42ab-b26c-5604d81964a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:46 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5b330063-c414-43cb-8951-b8b6325dc7b1 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-58505c5d-b53d-4ca3-82a4-c48b05eea5e2" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:46 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5b330063-c414-43cb-8951-b8b6325dc7b1 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-58505c5d-b53d-4ca3-82a4-c48b05eea5e2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:46 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5b330063-c414-43cb-8951-b8b6325dc7b1 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-cab68c0a-592a-42ab-b26c-5604d81964a9" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:46 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5b330063-c414-43cb-8951-b8b6325dc7b1 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-cab68c0a-592a-42ab-b26c-5604d81964a9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:46 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-5b330063-c414-43cb-8951-b8b6325dc7b1 tempest-ProjectMemberTests-1858363890 None] Deleting offline snapshot cab68c0a-592a-42ab-b26c-5604d81964a9 of volume 58505c5d-b53d-4ca3-82a4-c48b05eea5e2 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:05:46 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-5b330063-c414-43cb-8951-b8b6325dc7b1 tempest-ProjectMemberTests-1858363890 None] snapshot_file for this snap is: volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.cab68c0a-592a-42ab-b26c-5604d81964a9 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:05:46 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af92af2-a882-4b55-93c0-e47e92e120ef]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5b330063-c414-43cb-8951-b8b6325dc7b1 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.cab68c0a-592a-42ab-b26c-5604d81964a9 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:46 devstack sudo[108994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.cab68c0a-592a-42ab-b26c-5604d81964a9 Sep 07 14:05:46 devstack sudo[108994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:46 devstack sudo[108989]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a483da9-4ecd-4be7-ab6b-2852d4391de5 1073741824" returned: 0 in 0.508s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a483da9-4ecd-4be7-ab6b-2852d4391de5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:46 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a483da9-4ecd-4be7-ab6b-2852d4391de5 Sep 07 14:05:46 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:46 devstack sudo[108994]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5b330063-c414-43cb-8951-b8b6325dc7b1 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.cab68c0a-592a-42ab-b26c-5604d81964a9" returned: 0 in 0.370s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:46 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-5b330063-c414-43cb-8951-b8b6325dc7b1 tempest-ProjectMemberTests-1858363890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:05:46 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdc0241-fb38-465a-b521-630baf43d061]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5b330063-c414-43cb-8951-b8b6325dc7b1 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:46 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a483da9-4ecd-4be7-ab6b-2852d4391de5" returned: 0 in 0.271s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:46 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:46 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:46 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a0bbca-3416-467e-baea-537f2b8c10b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a483da9-4ecd-4be7-ab6b-2852d4391de5', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:46 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d9e480-86fa-4217-bb20-3bd7dcd04d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:46 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Volume volume-7a483da9-4ecd-4be7-ab6b-2852d4391de5 (7a483da9-4ecd-4be7-ab6b-2852d4391de5): created successfully Sep 07 14:05:46 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d9e480-86fa-4217-bb20-3bd7dcd04d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:46 devstack sudo[109002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2 Sep 07 14:05:46 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:46 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Flow 'volume_create_manager' (a71573e2-01a1-435c-adb4-767fb5163c02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:46 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-69ce1114-4a9c-41a9-891e-e7a395e13727 tempest-ProjectReaderTests-1200346658 None] Created volume successfully. Sep 07 14:05:47 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5b330063-c414-43cb-8951-b8b6325dc7b1 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2" returned: 0 in 0.349s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5b330063-c414-43cb-8951-b8b6325dc7b1 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.cab68c0a-592a-42ab-b26c-5604d81964a9 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:47 devstack sudo[109008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.cab68c0a-592a-42ab-b26c-5604d81964a9 Sep 07 14:05:47 devstack sudo[109008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:47 devstack sudo[109008]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5b330063-c414-43cb-8951-b8b6325dc7b1 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.cab68c0a-592a-42ab-b26c-5604d81964a9" returned: 0 in 0.334s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5b330063-c414-43cb-8951-b8b6325dc7b1 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.cab68c0a-592a-42ab-b26c-5604d81964a9 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:47 devstack sudo[109013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.cab68c0a-592a-42ab-b26c-5604d81964a9 Sep 07 14:05:47 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c31cf0b3-e842-4a85-8b0a-7c4366cd233d tempest-ProjectReaderTests-1200346658 None] Acquiring lock "cinder-7a483da9-4ecd-4be7-ab6b-2852d4391de5-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c31cf0b3-e842-4a85-8b0a-7c4366cd233d tempest-ProjectReaderTests-1200346658 None] Lock "cinder-7a483da9-4ecd-4be7-ab6b-2852d4391de5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:47 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c31cf0b3-e842-4a85-8b0a-7c4366cd233d tempest-ProjectReaderTests-1200346658 None] Acquiring lock "cinder-quobyte-7a483da9-4ecd-4be7-ab6b-2852d4391de5" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-5b330063-c414-43cb-8951-b8b6325dc7b1 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2.cab68c0a-592a-42ab-b26c-5604d81964a9" returned: 0 in 0.276s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5b330063-c414-43cb-8951-b8b6325dc7b1 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-cab68c0a-592a-42ab-b26c-5604d81964a9" released by "_delete_snapshot" :: held 1.430s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c31cf0b3-e842-4a85-8b0a-7c4366cd233d tempest-ProjectReaderTests-1200346658 None] Lock "cinder-quobyte-7a483da9-4ecd-4be7-ab6b-2852d4391de5" acquired by "delete_volume" :: waited 0.037s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5b330063-c414-43cb-8951-b8b6325dc7b1 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-58505c5d-b53d-4ca3-82a4-c48b05eea5e2" released by "delete_snapshot" :: held 1.469s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:47 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d94d331-8b48-4d8b-9a39-f3318ad72a5e]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:47 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c31cf0b3-e842-4a85-8b0a-7c4366cd233d tempest-ProjectReaderTests-1200346658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a483da9-4ecd-4be7-ab6b-2852d4391de5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:47 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-5b330063-c414-43cb-8951-b8b6325dc7b1 tempest-ProjectMemberTests-1858363890 None] Created reservations ['7afe9c54-cd55-41a3-8b6b-0c1473b19ebd', '8eca100e-c80d-4ab3-9e80-dec1f3ec0425', 'ec0ad54a-7f02-4ff5-ae6c-e24577926515', '97f5703e-09be-4cbc-87de-23e833b229a5'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:47 devstack sudo[109016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a483da9-4ecd-4be7-ab6b-2852d4391de5 Sep 07 14:05:47 devstack sudo[109016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:47 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-5b330063-c414-43cb-8951-b8b6325dc7b1 tempest-ProjectMemberTests-1858363890 None] Delete snapshot completed successfully. Sep 07 14:05:47 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-5b330063-c414-43cb-8951-b8b6325dc7b1 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-cab68c0a-592a-42ab-b26c-5604d81964a9-delete_snapshot" released by "delete_snapshot" :: held 1.643s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:48 devstack sudo[109016]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c31cf0b3-e842-4a85-8b0a-7c4366cd233d tempest-ProjectReaderTests-1200346658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a483da9-4ecd-4be7-ab6b-2852d4391de5" returned: 0 in 0.385s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c31cf0b3-e842-4a85-8b0a-7c4366cd233d tempest-ProjectReaderTests-1200346658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a483da9-4ecd-4be7-ab6b-2852d4391de5 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:48 devstack sudo[109022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a483da9-4ecd-4be7-ab6b-2852d4391de5 Sep 07 14:05:48 devstack sudo[109022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9c475618-d752-49f2-bbac-7c1f827327c4 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-58505c5d-b53d-4ca3-82a4-c48b05eea5e2-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:48 devstack sudo[109022]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c31cf0b3-e842-4a85-8b0a-7c4366cd233d tempest-ProjectReaderTests-1200346658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-7a483da9-4ecd-4be7-ab6b-2852d4391de5" returned: 0 in 0.281s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9c475618-d752-49f2-bbac-7c1f827327c4 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-58505c5d-b53d-4ca3-82a4-c48b05eea5e2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c31cf0b3-e842-4a85-8b0a-7c4366cd233d tempest-ProjectReaderTests-1200346658 None] Lock "cinder-quobyte-7a483da9-4ecd-4be7-ab6b-2852d4391de5" released by "delete_volume" :: held 0.724s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9c475618-d752-49f2-bbac-7c1f827327c4 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-58505c5d-b53d-4ca3-82a4-c48b05eea5e2" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:48 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9c475618-d752-49f2-bbac-7c1f827327c4 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-58505c5d-b53d-4ca3-82a4-c48b05eea5e2" acquired by "delete_volume" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:48 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b9b890-47da-40d1-9493-79a96ef12060]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9c475618-d752-49f2-bbac-7c1f827327c4 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:48 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-c31cf0b3-e842-4a85-8b0a-7c4366cd233d tempest-ProjectReaderTests-1200346658 None] Created reservations ['f3f4ede9-0ea4-4b5f-8ae9-e964ee24a72a', 'a1c1200b-5bff-4de6-bc6d-ff30dd948595', '26737c61-b3ee-470b-bd48-14aaeb6d564e', 'b81799ff-f20a-4510-9698-bc542f89bba0'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c31cf0b3-e842-4a85-8b0a-7c4366cd233d tempest-ProjectReaderTests-1200346658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c31cf0b3-e842-4a85-8b0a-7c4366cd233d tempest-ProjectReaderTests-1200346658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c31cf0b3-e842-4a85-8b0a-7c4366cd233d tempest-ProjectReaderTests-1200346658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:48 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-c31cf0b3-e842-4a85-8b0a-7c4366cd233d tempest-ProjectReaderTests-1200346658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-c31cf0b3-e842-4a85-8b0a-7c4366cd233d tempest-ProjectReaderTests-1200346658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c31cf0b3-e842-4a85-8b0a-7c4366cd233d tempest-ProjectReaderTests-1200346658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:48 devstack sudo[109025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2 Sep 07 14:05:48 devstack sudo[109025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:48 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:05:48 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:48 devstack sudo[109025]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9c475618-d752-49f2-bbac-7c1f827327c4 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2" returned: 0 in 0.424s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9c475618-d752-49f2-bbac-7c1f827327c4 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:48 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:48 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-c31cf0b3-e842-4a85-8b0a-7c4366cd233d tempest-ProjectReaderTests-1200346658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.350s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:48 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-c31cf0b3-e842-4a85-8b0a-7c4366cd233d tempest-ProjectReaderTests-1200346658 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:49 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-c31cf0b3-e842-4a85-8b0a-7c4366cd233d tempest-ProjectReaderTests-1200346658 None] Deleted volume successfully. Sep 07 14:05:49 devstack sudo[109033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2 Sep 07 14:05:49 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:49 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-c31cf0b3-e842-4a85-8b0a-7c4366cd233d tempest-ProjectReaderTests-1200346658 None] Lock "cinder-7a483da9-4ecd-4be7-ab6b-2852d4391de5-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:49 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9c475618-d752-49f2-bbac-7c1f827327c4 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-58505c5d-b53d-4ca3-82a4-c48b05eea5e2" returned: 0 in 0.290s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:49 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9c475618-d752-49f2-bbac-7c1f827327c4 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-58505c5d-b53d-4ca3-82a4-c48b05eea5e2" released by "delete_volume" :: held 0.784s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:49 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-9c475618-d752-49f2-bbac-7c1f827327c4 tempest-ProjectMemberTests-1858363890 None] Created reservations ['a3b227a2-e1bd-44d7-9111-adc74638f835', '514457af-f54f-4aaf-b34e-3788d74e6808', '8d5fabfb-eed5-4f53-8464-aef0149ac68e', '04bedc23-a96c-4dec-8d76-a23d759a621f'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9c475618-d752-49f2-bbac-7c1f827327c4 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9c475618-d752-49f2-bbac-7c1f827327c4 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:49 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9c475618-d752-49f2-bbac-7c1f827327c4 tempest-ProjectMemberTests-1858363890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:49 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-9c475618-d752-49f2-bbac-7c1f827327c4 tempest-ProjectMemberTests-1858363890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-9c475618-d752-49f2-bbac-7c1f827327c4 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9c475618-d752-49f2-bbac-7c1f827327c4 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:49 devstack sudo[109036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:05:49 devstack sudo[109036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:49 devstack sudo[109036]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:49 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9c475618-d752-49f2-bbac-7c1f827327c4 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.307s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:49 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-9c475618-d752-49f2-bbac-7c1f827327c4 tempest-ProjectMemberTests-1858363890 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:49 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-9c475618-d752-49f2-bbac-7c1f827327c4 tempest-ProjectMemberTests-1858363890 None] Deleted volume successfully. Sep 07 14:05:49 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9c475618-d752-49f2-bbac-7c1f827327c4 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-58505c5d-b53d-4ca3-82a4-c48b05eea5e2-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Flow 'volume_create_manager' (10868523-407b-4a4a-9134-68b62299a11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99332a6d-84e4-4640-9804-42f05209ed05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99332a6d-84e4-4640-9804-42f05209ed05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1113472721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce359b88-02be-4dc6-b76f-dcf5f174c11d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8fd9674bb249b899d5c69373880941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:50Z,use_quota=True,user_id='30c462f1a0094053b9f39392ba6e3442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15143847-b30a-4cd5-a5b7-2b1ab575d5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15143847-b30a-4cd5-a5b7-2b1ab575d5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c51e46-153f-42e0-b191-b7e1c04b4983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c51e46-153f-42e0-b191-b7e1c04b4983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce359b88-02be-4dc6-b76f-dcf5f174c11d', 'volume_name': 'volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4b2557-6cc1-4890-950b-0c5587bb1f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4b2557-6cc1-4890-950b-0c5587bb1f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9e0d48-0301-4f23-967d-ee2456c4780c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:50 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Volume ce359b88-02be-4dc6-b76f-dcf5f174c11d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d', 'volume_size': 1} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1113472721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce359b88-02be-4dc6-b76f-dcf5f174c11d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8fd9674bb249b899d5c69373880941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:50Z,use_quota=True,user_id='30c462f1a0094053b9f39392ba6e3442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Creating volume ce359b88-02be-4dc6-b76f-dcf5f174c11d {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:50 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:50 devstack sudo[109039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d 1073741824 Sep 07 14:05:50 devstack sudo[109039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:50 devstack sudo[109039]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d 1073741824" returned: 0 in 0.470s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:50 devstack sudo[109045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d Sep 07 14:05:50 devstack sudo[109045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:50 devstack sudo[109045]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d" returned: 0 in 0.260s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9e0d48-0301-4f23-967d-ee2456c4780c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94926dfb-743a-4f57-866e-ee966560d065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:50 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Volume volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d (ce359b88-02be-4dc6-b76f-dcf5f174c11d): created successfully Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94926dfb-743a-4f57-866e-ee966560d065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:50 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Flow 'volume_create_manager' (10868523-407b-4a4a-9134-68b62299a11b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:50 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-718284ba-190c-46b3-9b04-627b21d91050 tempest-ProjectMemberTests-1858363890 None] Created volume successfully. Sep 07 14:05:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4174b895-71f6-4475-ac6f-6b364aa19167 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4174b895-71f6-4475-ac6f-6b364aa19167 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:52 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-4174b895-71f6-4475-ac6f-6b364aa19167 tempest-ProjectMemberTests-1858363890 None] Creating offline snapshot bc8ede90-5b57-4aa4-a266-00101bda37c1 of volume ce359b88-02be-4dc6-b76f-dcf5f174c11d {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:05:52 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[92682365-dfd9-4f99-ab83-f928e7894c3f]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4174b895-71f6-4475-ac6f-6b364aa19167 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:52 devstack sudo[109048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d Sep 07 14:05:52 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:52 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4174b895-71f6-4475-ac6f-6b364aa19167 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d" returned: 0 in 0.373s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:52 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4174b895-71f6-4475-ac6f-6b364aa19167 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.bc8ede90-5b57-4aa4-a266-00101bda37c1 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:52 devstack sudo[109053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.bc8ede90-5b57-4aa4-a266-00101bda37c1 1G Sep 07 14:05:52 devstack sudo[109053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:53 devstack sudo[109053]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4174b895-71f6-4475-ac6f-6b364aa19167 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.bc8ede90-5b57-4aa4-a266-00101bda37c1 1G" returned: 0 in 0.415s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4174b895-71f6-4475-ac6f-6b364aa19167 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.bc8ede90-5b57-4aa4-a266-00101bda37c1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:53 devstack sudo[109059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.bc8ede90-5b57-4aa4-a266-00101bda37c1 Sep 07 14:05:53 devstack sudo[109059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:53 devstack sudo[109059]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4174b895-71f6-4475-ac6f-6b364aa19167 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.bc8ede90-5b57-4aa4-a266-00101bda37c1" returned: 0 in 0.296s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:53 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-4174b895-71f6-4475-ac6f-6b364aa19167 tempest-ProjectMemberTests-1858363890 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.bc8ede90-5b57-4aa4-a266-00101bda37c1 is being set with open permissions: ugo+rw Sep 07 14:05:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4174b895-71f6-4475-ac6f-6b364aa19167 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.bc8ede90-5b57-4aa4-a266-00101bda37c1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:53 devstack sudo[109064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.bc8ede90-5b57-4aa4-a266-00101bda37c1 Sep 07 14:05:53 devstack sudo[109064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:53 devstack sudo[109064]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4174b895-71f6-4475-ac6f-6b364aa19167 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.bc8ede90-5b57-4aa4-a266-00101bda37c1" returned: 0 in 0.255s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:53 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4174b895-71f6-4475-ac6f-6b364aa19167 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:53 devstack sudo[109067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.info Sep 07 14:05:53 devstack sudo[109067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:54 devstack sudo[109067]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4174b895-71f6-4475-ac6f-6b364aa19167 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.info" returned: 0 in 0.257s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:54 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-4174b895-71f6-4475-ac6f-6b364aa19167 tempest-ProjectMemberTests-1858363890 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.info is being set with open permissions: ugo+rw Sep 07 14:05:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4174b895-71f6-4475-ac6f-6b364aa19167 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:54 devstack sudo[109070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.info Sep 07 14:05:54 devstack sudo[109070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:54 devstack sudo[109070]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-4174b895-71f6-4475-ac6f-6b364aa19167 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.info" returned: 0 in 0.269s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-4174b895-71f6-4475-ac6f-6b364aa19167 tempest-ProjectMemberTests-1858363890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.960s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:54 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-4174b895-71f6-4475-ac6f-6b364aa19167 tempest-ProjectMemberTests-1858363890 None] Create snapshot completed successfully Sep 07 14:05:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9b7cb0b0-e308-4e9c-893c-4f75b9248520 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-bc8ede90-5b57-4aa4-a266-00101bda37c1-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9b7cb0b0-e308-4e9c-893c-4f75b9248520 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-bc8ede90-5b57-4aa4-a266-00101bda37c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9b7cb0b0-e308-4e9c-893c-4f75b9248520 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-ce359b88-02be-4dc6-b76f-dcf5f174c11d" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9b7cb0b0-e308-4e9c-893c-4f75b9248520 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-ce359b88-02be-4dc6-b76f-dcf5f174c11d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9b7cb0b0-e308-4e9c-893c-4f75b9248520 tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-bc8ede90-5b57-4aa4-a266-00101bda37c1" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:54 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9b7cb0b0-e308-4e9c-893c-4f75b9248520 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-bc8ede90-5b57-4aa4-a266-00101bda37c1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:54 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-9b7cb0b0-e308-4e9c-893c-4f75b9248520 tempest-ProjectMemberTests-1858363890 None] Deleting offline snapshot bc8ede90-5b57-4aa4-a266-00101bda37c1 of volume ce359b88-02be-4dc6-b76f-dcf5f174c11d {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:05:54 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-9b7cb0b0-e308-4e9c-893c-4f75b9248520 tempest-ProjectMemberTests-1858363890 None] snapshot_file for this snap is: volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.bc8ede90-5b57-4aa4-a266-00101bda37c1 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:05:54 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f64783-205f-4d26-9863-65edc2fb6f92]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:54 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9b7cb0b0-e308-4e9c-893c-4f75b9248520 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.bc8ede90-5b57-4aa4-a266-00101bda37c1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:54 devstack sudo[109073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.bc8ede90-5b57-4aa4-a266-00101bda37c1 Sep 07 14:05:54 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:55 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9b7cb0b0-e308-4e9c-893c-4f75b9248520 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.bc8ede90-5b57-4aa4-a266-00101bda37c1" returned: 0 in 0.369s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:55 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-9b7cb0b0-e308-4e9c-893c-4f75b9248520 tempest-ProjectMemberTests-1858363890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:05:55 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[88db202e-9dc6-4cb3-9c79-05d6aa291179]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9b7cb0b0-e308-4e9c-893c-4f75b9248520 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:55 devstack sudo[109078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d Sep 07 14:05:55 devstack sudo[109078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:55 devstack sudo[109078]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9b7cb0b0-e308-4e9c-893c-4f75b9248520 tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d" returned: 0 in 0.422s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9b7cb0b0-e308-4e9c-893c-4f75b9248520 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.bc8ede90-5b57-4aa4-a266-00101bda37c1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:55 devstack sudo[109083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.bc8ede90-5b57-4aa4-a266-00101bda37c1 Sep 07 14:05:55 devstack sudo[109083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:55 devstack sudo[109083]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9b7cb0b0-e308-4e9c-893c-4f75b9248520 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.bc8ede90-5b57-4aa4-a266-00101bda37c1" returned: 0 in 0.332s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:55 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9b7cb0b0-e308-4e9c-893c-4f75b9248520 tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.bc8ede90-5b57-4aa4-a266-00101bda37c1 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:55 devstack sudo[109088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.bc8ede90-5b57-4aa4-a266-00101bda37c1 Sep 07 14:05:55 devstack sudo[109088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:56 devstack sudo[109088]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-9b7cb0b0-e308-4e9c-893c-4f75b9248520 tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d.bc8ede90-5b57-4aa4-a266-00101bda37c1" returned: 0 in 0.240s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9b7cb0b0-e308-4e9c-893c-4f75b9248520 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-bc8ede90-5b57-4aa4-a266-00101bda37c1" released by "_delete_snapshot" :: held 1.451s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9b7cb0b0-e308-4e9c-893c-4f75b9248520 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-ce359b88-02be-4dc6-b76f-dcf5f174c11d" released by "delete_snapshot" :: held 1.476s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:56 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-9b7cb0b0-e308-4e9c-893c-4f75b9248520 tempest-ProjectMemberTests-1858363890 None] Created reservations ['15c7641c-548c-4d2a-9e55-208b31ba34e3', 'dee4de3e-6018-42db-8242-5501e0a68379', 'e703c340-245f-4a19-9a06-11ab546878b5', '25d04f2d-a908-428f-9b1a-a1e986ff5c11'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:56 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-9b7cb0b0-e308-4e9c-893c-4f75b9248520 tempest-ProjectMemberTests-1858363890 None] Delete snapshot completed successfully. Sep 07 14:05:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-9b7cb0b0-e308-4e9c-893c-4f75b9248520 tempest-ProjectMemberTests-1858363890 None] Lock "cinder-bc8ede90-5b57-4aa4-a266-00101bda37c1-delete_snapshot" released by "delete_snapshot" :: held 1.626s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2f152e38-7681-4ef3-9f38-c1bfc293864d tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-ce359b88-02be-4dc6-b76f-dcf5f174c11d-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2f152e38-7681-4ef3-9f38-c1bfc293864d tempest-ProjectMemberTests-1858363890 None] Lock "cinder-ce359b88-02be-4dc6-b76f-dcf5f174c11d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2f152e38-7681-4ef3-9f38-c1bfc293864d tempest-ProjectMemberTests-1858363890 None] Acquiring lock "cinder-quobyte-ce359b88-02be-4dc6-b76f-dcf5f174c11d" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:56 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2f152e38-7681-4ef3-9f38-c1bfc293864d tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-ce359b88-02be-4dc6-b76f-dcf5f174c11d" acquired by "delete_volume" :: waited 0.015s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:56 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[69069a03-9051-49ef-8f4e-95b5986f8ea2]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:56 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2f152e38-7681-4ef3-9f38-c1bfc293864d tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:56 devstack sudo[109091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d Sep 07 14:05:56 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:57 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2f152e38-7681-4ef3-9f38-c1bfc293864d tempest-ProjectMemberTests-1858363890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d" returned: 0 in 0.360s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2f152e38-7681-4ef3-9f38-c1bfc293864d tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:57 devstack sudo[109096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d Sep 07 14:05:57 devstack sudo[109096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:57 devstack sudo[109096]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2f152e38-7681-4ef3-9f38-c1bfc293864d tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-ce359b88-02be-4dc6-b76f-dcf5f174c11d" returned: 0 in 0.247s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2f152e38-7681-4ef3-9f38-c1bfc293864d tempest-ProjectMemberTests-1858363890 None] Lock "cinder-quobyte-ce359b88-02be-4dc6-b76f-dcf5f174c11d" released by "delete_volume" :: held 0.667s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:57 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-2f152e38-7681-4ef3-9f38-c1bfc293864d tempest-ProjectMemberTests-1858363890 None] Created reservations ['c67ac64d-3bf6-4570-98a8-ae9678c50b36', 'd4835458-ddcf-4370-b579-978760aa09c5', 'f2f1e06e-3607-42ab-afda-ce40d099ec3b', 'd3b5bbb5-f2c1-4c87-88a0-4deb0b0fddd3'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2f152e38-7681-4ef3-9f38-c1bfc293864d tempest-ProjectMemberTests-1858363890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2f152e38-7681-4ef3-9f38-c1bfc293864d tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2f152e38-7681-4ef3-9f38-c1bfc293864d tempest-ProjectMemberTests-1858363890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:57 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-2f152e38-7681-4ef3-9f38-c1bfc293864d tempest-ProjectMemberTests-1858363890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-2f152e38-7681-4ef3-9f38-c1bfc293864d tempest-ProjectMemberTests-1858363890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2f152e38-7681-4ef3-9f38-c1bfc293864d tempest-ProjectMemberTests-1858363890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:57 devstack sudo[109099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:05:57 devstack sudo[109099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:57 devstack sudo[109099]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:57 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-2f152e38-7681-4ef3-9f38-c1bfc293864d tempest-ProjectMemberTests-1858363890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.251s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:57 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-2f152e38-7681-4ef3-9f38-c1bfc293864d tempest-ProjectMemberTests-1858363890 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:57 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-2f152e38-7681-4ef3-9f38-c1bfc293864d tempest-ProjectMemberTests-1858363890 None] Deleted volume successfully. Sep 07 14:05:57 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-2f152e38-7681-4ef3-9f38-c1bfc293864d tempest-ProjectMemberTests-1858363890 None] Lock "cinder-ce359b88-02be-4dc6-b76f-dcf5f174c11d-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:07 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=194,cinder:INSERT=73,cinder:UPDATE=251,cinder:DELETE=23 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:06:07 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:UPDATE=264,cinder:SELECT=193,cinder:INSERT=67,cinder:DELETE=18 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:06:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:06:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:06:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:06:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:06:28 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:06:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:06:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:28 devstack sudo[109152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:06:28 devstack sudo[109152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:28 devstack sudo[109152]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:28 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.263s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:28 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:06:28 devstack cinder-volume[87571]: DEBUG oslo_service.periodic_task [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] Running periodic task VolumeManager._thread_info {{(pid=87571) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:06:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread count: 28 {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 14:06:28 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-992ce8e1-69b9-46a3-b7fe-8d43ed48e51b None None] thread info: [<_MainThread(MainThread, started 132147689414784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87571) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 14:06:29 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:06:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Flow 'volume_create_manager' (6c335a7b-0d56-4c1a-beb4-538c31658246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:06:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8755e7-86dd-452c-8b1b-cb9f47174a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8755e7-86dd-452c-8b1b-cb9f47174a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1784155038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f5f768e-6de3-42f2-81d2-f3031ce6c25d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14e5872931c745d9a7924013ef73d291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:06:30Z,use_quota=True,user_id='4703bbf2e3c6461eb60caa49037bd367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662eb143-2645-4efd-bf65-506acb7d0112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662eb143-2645-4efd-bf65-506acb7d0112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d8fafd-a4ad-47bb-ac9d-2676c2ab27e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d8fafd-a4ad-47bb-ac9d-2676c2ab27e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f5f768e-6de3-42f2-81d2-f3031ce6c25d', 'volume_name': 'volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:29 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9401bddc-51fa-4123-a294-ba352c92c103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9401bddc-51fa-4123-a294-ba352c92c103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb2ecd4-0774-47fd-9cae-070b483dc3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:30 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Volume 3f5f768e-6de3-42f2-81d2-f3031ce6c25d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d', 'volume_size': 1} Sep 07 14:06:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:06:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:06:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1784155038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f5f768e-6de3-42f2-81d2-f3031ce6c25d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14e5872931c745d9a7924013ef73d291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:06:30Z,use_quota=True,user_id='4703bbf2e3c6461eb60caa49037bd367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)}" {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:06:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Creating volume 3f5f768e-6de3-42f2-81d2-f3031ce6c25d {{(pid=87571) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:06:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:06:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:06:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:06:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:06:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:06:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:06:30 devstack cinder-volume[87571]: INFO cinder.volume.drivers.remotefs [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] casted to osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 Sep 07 14:06:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d 1073741824 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:30 devstack sudo[109155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d 1073741824 Sep 07 14:06:30 devstack sudo[109155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:30 devstack sudo[109155]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d 1073741824" returned: 0 in 0.391s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:30 devstack sudo[109160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d Sep 07 14:06:30 devstack sudo[109160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:30 devstack sudo[109160]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d" returned: 0 in 0.252s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:30 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'} {{(pid=87571) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:06:30 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:06:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb2ecd4-0774-47fd-9cae-070b483dc3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d', 'volume_size': 1}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930fa880-873b-4be1-9c5e-93812c996b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:30 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Volume volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d (3f5f768e-6de3-42f2-81d2-f3031ce6c25d): created successfully Sep 07 14:06:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930fa880-873b-4be1-9c5e-93812c996b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:30 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Flow 'volume_create_manager' (6c335a7b-0d56-4c1a-beb4-538c31658246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:06:30 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-8b3d6944-425f-40b6-bd90-ca85df53e8a9 tempest-SnapshotDependencyTests-1722212696 None] Created volume successfully. Sep 07 14:06:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-237c548a-a981-4e44-bfdf-dcaa80d87c3a tempest-SnapshotDependencyTests-1722212696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:06:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-237c548a-a981-4e44-bfdf-dcaa80d87c3a tempest-SnapshotDependencyTests-1722212696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:06:31 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-237c548a-a981-4e44-bfdf-dcaa80d87c3a tempest-SnapshotDependencyTests-1722212696 None] Creating offline snapshot eb280e78-d292-4710-aef5-873d7d5f5c91 of volume 3f5f768e-6de3-42f2-81d2-f3031ce6c25d {{(pid=87571) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:06:31 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[417e5d71-76ec-4acd-bcba-1781d5c68818]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:06:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-237c548a-a981-4e44-bfdf-dcaa80d87c3a tempest-SnapshotDependencyTests-1722212696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:31 devstack sudo[109163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d Sep 07 14:06:31 devstack sudo[109163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:31 devstack sudo[109163]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-237c548a-a981-4e44-bfdf-dcaa80d87c3a tempest-SnapshotDependencyTests-1722212696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d" returned: 0 in 0.353s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-237c548a-a981-4e44-bfdf-dcaa80d87c3a tempest-SnapshotDependencyTests-1722212696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.eb280e78-d292-4710-aef5-873d7d5f5c91 1G {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:31 devstack sudo[109168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.eb280e78-d292-4710-aef5-873d7d5f5c91 1G Sep 07 14:06:31 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:31 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-237c548a-a981-4e44-bfdf-dcaa80d87c3a tempest-SnapshotDependencyTests-1722212696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.eb280e78-d292-4710-aef5-873d7d5f5c91 1G" returned: 0 in 0.374s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:31 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-237c548a-a981-4e44-bfdf-dcaa80d87c3a tempest-SnapshotDependencyTests-1722212696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.eb280e78-d292-4710-aef5-873d7d5f5c91 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:31 devstack sudo[109174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.eb280e78-d292-4710-aef5-873d7d5f5c91 Sep 07 14:06:31 devstack sudo[109174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:32 devstack sudo[109174]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-237c548a-a981-4e44-bfdf-dcaa80d87c3a tempest-SnapshotDependencyTests-1722212696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d -F qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.eb280e78-d292-4710-aef5-873d7d5f5c91" returned: 0 in 0.280s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:32 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-237c548a-a981-4e44-bfdf-dcaa80d87c3a tempest-SnapshotDependencyTests-1722212696 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.eb280e78-d292-4710-aef5-873d7d5f5c91 is being set with open permissions: ugo+rw Sep 07 14:06:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-237c548a-a981-4e44-bfdf-dcaa80d87c3a tempest-SnapshotDependencyTests-1722212696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.eb280e78-d292-4710-aef5-873d7d5f5c91 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:32 devstack sudo[109180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.eb280e78-d292-4710-aef5-873d7d5f5c91 Sep 07 14:06:32 devstack sudo[109180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:32 devstack sudo[109180]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-237c548a-a981-4e44-bfdf-dcaa80d87c3a tempest-SnapshotDependencyTests-1722212696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.eb280e78-d292-4710-aef5-873d7d5f5c91" returned: 0 in 0.232s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-237c548a-a981-4e44-bfdf-dcaa80d87c3a tempest-SnapshotDependencyTests-1722212696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:32 devstack sudo[109183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.info Sep 07 14:06:32 devstack sudo[109183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:32 devstack sudo[109183]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-237c548a-a981-4e44-bfdf-dcaa80d87c3a tempest-SnapshotDependencyTests-1722212696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.info" returned: 0 in 0.238s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:32 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-237c548a-a981-4e44-bfdf-dcaa80d87c3a tempest-SnapshotDependencyTests-1722212696 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.info is being set with open permissions: ugo+rw Sep 07 14:06:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-237c548a-a981-4e44-bfdf-dcaa80d87c3a tempest-SnapshotDependencyTests-1722212696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.info {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:32 devstack sudo[109186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.info Sep 07 14:06:32 devstack sudo[109186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:32 devstack sudo[109186]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-237c548a-a981-4e44-bfdf-dcaa80d87c3a tempest-SnapshotDependencyTests-1722212696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.info" returned: 0 in 0.235s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:32 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-237c548a-a981-4e44-bfdf-dcaa80d87c3a tempest-SnapshotDependencyTests-1722212696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.787s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:06:32 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-237c548a-a981-4e44-bfdf-dcaa80d87c3a tempest-SnapshotDependencyTests-1722212696 None] Create snapshot completed successfully Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87571) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1405}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Flow 'volume_create_manager' (6961b975-82f7-40dc-a2c6-91d6a79d001e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ac23c4-fe93-4e0a-8dc5-4cea1ea81174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ac23c4-fe93-4e0a-8dc5-4cea1ea81174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16c85d68-a214-41e7-9089-68071a53f8ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14e5872931c745d9a7924013ef73d291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eb280e78-d292-4710-aef5-873d7d5f5c91,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:06:34Z,use_quota=True,user_id='4703bbf2e3c6461eb60caa49037bd367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4530b95c-26d9-4a3c-98eb-8896b9671525),volume_type_id=4530b95c-26d9-4a3c-98eb-8896b9671525)' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b724ed-4ccf-45ca-8d8c-48df791674f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b724ed-4ccf-45ca-8d8c-48df791674f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816f24ff-b57c-433d-bcd5-95f4a79ba283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816f24ff-b57c-433d-bcd5-95f4a79ba283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '16c85d68-a214-41e7-9089-68071a53f8ea', 'volume_name': 'volume-16c85d68-a214-41e7-9089-68071a53f8ea', 'volume_size': 1, 'snapshot_id': 'eb280e78-d292-4710-aef5-873d7d5f5c91'}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d18c5c7-5239-4873-a5cd-2d30c5ad1369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d18c5c7-5239-4873-a5cd-2d30c5ad1369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3227a442-1c30-4fc1-a668-4c81130c15f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:33 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Volume 16c85d68-a214-41e7-9089-68071a53f8ea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-16c85d68-a214-41e7-9089-68071a53f8ea', 'volume_size': 1, 'snapshot_id': 'eb280e78-d292-4710-aef5-873d7d5f5c91'} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Acquiring lock "cinder-quobyte-eb280e78-d292-4710-aef5-873d7d5f5c91-16c85d68-a214-41e7-9089-68071a53f8ea" by "_create_volume_from_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Lock "cinder-quobyte-eb280e78-d292-4710-aef5-873d7d5f5c91-16c85d68-a214-41e7-9089-68071a53f8ea" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Creating volume 16c85d68-a214-41e7-9089-68071a53f8ea from snapshot eb280e78-d292-4710-aef5-873d7d5f5c91 {{(pid=87571) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Selected osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285 as target Quobyte volume. {{(pid=87571) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Acquiring lock "cinder-quobyte-16c85d68-a214-41e7-9089-68071a53f8ea" by "_copy_volume_from_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Lock "cinder-quobyte-16c85d68-a214-41e7-9089-68071a53f8ea" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] snapshot: eb280e78-d292-4710-aef5-873d7d5f5c91, volume: 16c85d68-a214-41e7-9089-68071a53f8ea, {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61aaae2-32fe-4994-b01d-69d798d7d946]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:06:33 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.eb280e78-d292-4710-aef5-873d7d5f5c91 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:34 devstack sudo[109189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.eb280e78-d292-4710-aef5-873d7d5f5c91 Sep 07 14:06:34 devstack sudo[109189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:34 devstack sudo[109189]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.eb280e78-d292-4710-aef5-873d7d5f5c91" returned: 0 in 0.346s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:06:34 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f85df0d-9817-455e-8e81-1afe793857fd]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:06:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:34 devstack sudo[109195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d Sep 07 14:06:34 devstack sudo[109195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:34 devstack sudo[109195]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d" returned: 0 in 0.329s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 14:06:34 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Creating direct copy from snapshot {{(pid=87571) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 14:06:34 devstack cinder-volume[87571]: DEBUG cinder.utils [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Path /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-16c85d68-a214-41e7-9089-68071a53f8ea not found in is_blk_device check {{(pid=87571) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 14:06:34 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-16c85d68-a214-41e7-9089-68071a53f8ea {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:34 devstack sudo[109200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-16c85d68-a214-41e7-9089-68071a53f8ea Sep 07 14:06:34 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:38 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-16c85d68-a214-41e7-9089-68071a53f8ea" returned: 0 in 3.802s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:38 devstack cinder-volume[87571]: DEBUG cinder.image.image_utils [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d, size 1024.00 MB, duration 3.80 sec, destination /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-16c85d68-a214-41e7-9089-68071a53f8ea {{(pid=87571) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 14:06:38 devstack cinder-volume[87571]: INFO cinder.image.image_utils [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Converted 1024.00 MB image at 269.24 MB/s Sep 07 14:06:38 devstack cinder-volume[87571]: WARNING cinder.volume.drivers.remotefs [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-16c85d68-a214-41e7-9089-68071a53f8ea is being set with open permissions: ugo+rw Sep 07 14:06:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-16c85d68-a214-41e7-9089-68071a53f8ea {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:38 devstack sudo[109216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-16c85d68-a214-41e7-9089-68071a53f8ea Sep 07 14:06:38 devstack sudo[109216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:38 devstack sudo[109216]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-16c85d68-a214-41e7-9089-68071a53f8ea" returned: 0 in 0.230s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Lock "cinder-quobyte-16c85d68-a214-41e7-9089-68071a53f8ea" released by "_copy_volume_from_snapshot" :: held 4.777s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:38 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Lock "cinder-quobyte-eb280e78-d292-4710-aef5-873d7d5f5c91-16c85d68-a214-41e7-9089-68071a53f8ea" released by "_create_volume_from_snapshot" :: held 4.831s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:38 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.845s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:06:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3227a442-1c30-4fc1-a668-4c81130c15f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16c85d68-a214-41e7-9089-68071a53f8ea', 'volume_size': 1, 'snapshot_id': 'eb280e78-d292-4710-aef5-873d7d5f5c91'}' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89d7ae20-8cfc-4896-86e7-6c0b5e440989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:38 devstack cinder-volume[87571]: INFO cinder.volume.flows.manager.create_volume [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Volume volume-16c85d68-a214-41e7-9089-68071a53f8ea (16c85d68-a214-41e7-9089-68071a53f8ea): created successfully Sep 07 14:06:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89d7ae20-8cfc-4896-86e7-6c0b5e440989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87571) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:38 devstack cinder-volume[87571]: DEBUG cinder.volume.manager [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Flow 'volume_create_manager' (6961b975-82f7-40dc-a2c6-91d6a79d001e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87571) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:06:38 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-3ac7cd21-9170-4fcc-bf62-26d524a63ddf tempest-SnapshotDependencyTests-1722212696 None] Created volume successfully. Sep 07 14:06:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3201aa85-fa96-4885-a84b-ca14c67bdd2e tempest-SnapshotDependencyTests-1722212696 None] Acquiring lock "cinder-eb280e78-d292-4710-aef5-873d7d5f5c91-delete_snapshot" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3201aa85-fa96-4885-a84b-ca14c67bdd2e tempest-SnapshotDependencyTests-1722212696 None] Lock "cinder-eb280e78-d292-4710-aef5-873d7d5f5c91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3201aa85-fa96-4885-a84b-ca14c67bdd2e tempest-SnapshotDependencyTests-1722212696 None] Acquiring lock "cinder-quobyte-3f5f768e-6de3-42f2-81d2-f3031ce6c25d" by "delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3201aa85-fa96-4885-a84b-ca14c67bdd2e tempest-SnapshotDependencyTests-1722212696 None] Lock "cinder-quobyte-3f5f768e-6de3-42f2-81d2-f3031ce6c25d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3201aa85-fa96-4885-a84b-ca14c67bdd2e tempest-SnapshotDependencyTests-1722212696 None] Acquiring lock "cinder-quobyte-eb280e78-d292-4710-aef5-873d7d5f5c91" by "_delete_snapshot" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:39 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3201aa85-fa96-4885-a84b-ca14c67bdd2e tempest-SnapshotDependencyTests-1722212696 None] Lock "cinder-quobyte-eb280e78-d292-4710-aef5-873d7d5f5c91" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-3201aa85-fa96-4885-a84b-ca14c67bdd2e tempest-SnapshotDependencyTests-1722212696 None] Deleting offline snapshot eb280e78-d292-4710-aef5-873d7d5f5c91 of volume 3f5f768e-6de3-42f2-81d2-f3031ce6c25d {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:06:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-3201aa85-fa96-4885-a84b-ca14c67bdd2e tempest-SnapshotDependencyTests-1722212696 None] snapshot_file for this snap is: volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.eb280e78-d292-4710-aef5-873d7d5f5c91 {{(pid=87571) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:06:39 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2933be58-08f9-4bf3-8a40-5abcc443c5f7]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:06:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3201aa85-fa96-4885-a84b-ca14c67bdd2e tempest-SnapshotDependencyTests-1722212696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.eb280e78-d292-4710-aef5-873d7d5f5c91 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:39 devstack sudo[109219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.eb280e78-d292-4710-aef5-873d7d5f5c91 Sep 07 14:06:39 devstack sudo[109219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:39 devstack sudo[109219]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3201aa85-fa96-4885-a84b-ca14c67bdd2e tempest-SnapshotDependencyTests-1722212696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.eb280e78-d292-4710-aef5-873d7d5f5c91" returned: 0 in 0.334s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:39 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.remotefs [None req-3201aa85-fa96-4885-a84b-ca14c67bdd2e tempest-SnapshotDependencyTests-1722212696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87571) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:06:39 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3a89cb-0a18-490c-a735-ec7c0748cde3]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:06:39 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3201aa85-fa96-4885-a84b-ca14c67bdd2e tempest-SnapshotDependencyTests-1722212696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:39 devstack sudo[109224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d Sep 07 14:06:39 devstack sudo[109224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:40 devstack sudo[109224]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3201aa85-fa96-4885-a84b-ca14c67bdd2e tempest-SnapshotDependencyTests-1722212696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d" returned: 0 in 0.493s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3201aa85-fa96-4885-a84b-ca14c67bdd2e tempest-SnapshotDependencyTests-1722212696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.eb280e78-d292-4710-aef5-873d7d5f5c91 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:40 devstack sudo[109229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.eb280e78-d292-4710-aef5-873d7d5f5c91 Sep 07 14:06:40 devstack sudo[109229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:40 devstack sudo[109229]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3201aa85-fa96-4885-a84b-ca14c67bdd2e tempest-SnapshotDependencyTests-1722212696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.eb280e78-d292-4710-aef5-873d7d5f5c91" returned: 0 in 0.307s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3201aa85-fa96-4885-a84b-ca14c67bdd2e tempest-SnapshotDependencyTests-1722212696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.eb280e78-d292-4710-aef5-873d7d5f5c91 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:40 devstack sudo[109234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.eb280e78-d292-4710-aef5-873d7d5f5c91 Sep 07 14:06:40 devstack sudo[109234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:40 devstack sudo[109234]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:40 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3201aa85-fa96-4885-a84b-ca14c67bdd2e tempest-SnapshotDependencyTests-1722212696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d.eb280e78-d292-4710-aef5-873d7d5f5c91" returned: 0 in 0.237s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:40 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3201aa85-fa96-4885-a84b-ca14c67bdd2e tempest-SnapshotDependencyTests-1722212696 None] Lock "cinder-quobyte-eb280e78-d292-4710-aef5-873d7d5f5c91" released by "_delete_snapshot" :: held 1.462s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:40 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3201aa85-fa96-4885-a84b-ca14c67bdd2e tempest-SnapshotDependencyTests-1722212696 None] Lock "cinder-quobyte-3f5f768e-6de3-42f2-81d2-f3031ce6c25d" released by "delete_snapshot" :: held 1.486s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:40 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-3201aa85-fa96-4885-a84b-ca14c67bdd2e tempest-SnapshotDependencyTests-1722212696 None] Created reservations ['3b0a5641-673f-4f67-8ec7-b0be6faa5fb5', '6b872411-b75f-435f-8b60-4342060945ce', '532fff61-3ece-42fb-8d10-95709cb7748a', '09c395a4-9f6a-4668-b6f0-99e6adbe6b5a'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:06:40 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-3201aa85-fa96-4885-a84b-ca14c67bdd2e tempest-SnapshotDependencyTests-1722212696 None] Delete snapshot completed successfully. Sep 07 14:06:40 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3201aa85-fa96-4885-a84b-ca14c67bdd2e tempest-SnapshotDependencyTests-1722212696 None] Lock "cinder-eb280e78-d292-4710-aef5-873d7d5f5c91-delete_snapshot" released by "delete_snapshot" :: held 1.606s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:41 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3fe53d35-f23d-47a1-9dd6-007a4de6df18 tempest-SnapshotDependencyTests-1722212696 None] Acquiring lock "cinder-3f5f768e-6de3-42f2-81d2-f3031ce6c25d-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:41 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3fe53d35-f23d-47a1-9dd6-007a4de6df18 tempest-SnapshotDependencyTests-1722212696 None] Lock "cinder-3f5f768e-6de3-42f2-81d2-f3031ce6c25d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:41 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3fe53d35-f23d-47a1-9dd6-007a4de6df18 tempest-SnapshotDependencyTests-1722212696 None] Acquiring lock "cinder-quobyte-3f5f768e-6de3-42f2-81d2-f3031ce6c25d" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:41 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3fe53d35-f23d-47a1-9dd6-007a4de6df18 tempest-SnapshotDependencyTests-1722212696 None] Lock "cinder-quobyte-3f5f768e-6de3-42f2-81d2-f3031ce6c25d" acquired by "delete_volume" :: waited 0.015s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:41 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[266218b7-86c8-440f-a903-a8637e20c2b5]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:06:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3fe53d35-f23d-47a1-9dd6-007a4de6df18 tempest-SnapshotDependencyTests-1722212696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:41 devstack sudo[109237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d Sep 07 14:06:41 devstack sudo[109237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:41 devstack sudo[109237]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3fe53d35-f23d-47a1-9dd6-007a4de6df18 tempest-SnapshotDependencyTests-1722212696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d" returned: 0 in 0.344s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:41 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3fe53d35-f23d-47a1-9dd6-007a4de6df18 tempest-SnapshotDependencyTests-1722212696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:41 devstack sudo[109242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d Sep 07 14:06:41 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:42 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3fe53d35-f23d-47a1-9dd6-007a4de6df18 tempest-SnapshotDependencyTests-1722212696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-3f5f768e-6de3-42f2-81d2-f3031ce6c25d" returned: 0 in 0.242s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3fe53d35-f23d-47a1-9dd6-007a4de6df18 tempest-SnapshotDependencyTests-1722212696 None] Lock "cinder-quobyte-3f5f768e-6de3-42f2-81d2-f3031ce6c25d" released by "delete_volume" :: held 0.636s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:42 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-3fe53d35-f23d-47a1-9dd6-007a4de6df18 tempest-SnapshotDependencyTests-1722212696 None] Created reservations ['3c29b0e1-6bf8-42e8-92fd-b64561f23054', 'a02cbc48-3e9c-4bba-a67f-95451e9aaac8', '3fe79187-1cde-4716-8c4d-61a6b31bad13', '5f6dd564-b5e5-4013-be3f-79e93b0eff41'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:06:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3fe53d35-f23d-47a1-9dd6-007a4de6df18 tempest-SnapshotDependencyTests-1722212696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:06:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3fe53d35-f23d-47a1-9dd6-007a4de6df18 tempest-SnapshotDependencyTests-1722212696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:06:42 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3fe53d35-f23d-47a1-9dd6-007a4de6df18 tempest-SnapshotDependencyTests-1722212696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:06:42 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-3fe53d35-f23d-47a1-9dd6-007a4de6df18 tempest-SnapshotDependencyTests-1722212696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:06:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-3fe53d35-f23d-47a1-9dd6-007a4de6df18 tempest-SnapshotDependencyTests-1722212696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:06:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3fe53d35-f23d-47a1-9dd6-007a4de6df18 tempest-SnapshotDependencyTests-1722212696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:42 devstack sudo[109245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:06:42 devstack sudo[109245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:42 devstack sudo[109245]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-3fe53d35-f23d-47a1-9dd6-007a4de6df18 tempest-SnapshotDependencyTests-1722212696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.252s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:42 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-3fe53d35-f23d-47a1-9dd6-007a4de6df18 tempest-SnapshotDependencyTests-1722212696 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:06:42 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-3fe53d35-f23d-47a1-9dd6-007a4de6df18 tempest-SnapshotDependencyTests-1722212696 None] Deleted volume successfully. Sep 07 14:06:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-3fe53d35-f23d-47a1-9dd6-007a4de6df18 tempest-SnapshotDependencyTests-1722212696 None] Lock "cinder-3f5f768e-6de3-42f2-81d2-f3031ce6c25d-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-38d1663d-ddd6-4140-9949-0384e7ba05a0 tempest-SnapshotDependencyTests-1722212696 None] Acquiring lock "cinder-16c85d68-a214-41e7-9089-68071a53f8ea-delete_volume" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-38d1663d-ddd6-4140-9949-0384e7ba05a0 tempest-SnapshotDependencyTests-1722212696 None] Lock "cinder-16c85d68-a214-41e7-9089-68071a53f8ea-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-38d1663d-ddd6-4140-9949-0384e7ba05a0 tempest-SnapshotDependencyTests-1722212696 None] Acquiring lock "cinder-quobyte-16c85d68-a214-41e7-9089-68071a53f8ea" by "delete_volume" {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:42 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-38d1663d-ddd6-4140-9949-0384e7ba05a0 tempest-SnapshotDependencyTests-1722212696 None] Lock "cinder-quobyte-16c85d68-a214-41e7-9089-68071a53f8ea" acquired by "delete_volume" :: waited 0.013s {{(pid=87571) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:42 devstack cinder-volume[87571]: DEBUG oslo.privsep.daemon [-] privsep: reply[14afe721-df51-40e8-9c2a-a499a92643a7]: (4, 'qcow2') {{(pid=89153) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:06:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-38d1663d-ddd6-4140-9949-0384e7ba05a0 tempest-SnapshotDependencyTests-1722212696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-16c85d68-a214-41e7-9089-68071a53f8ea {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:42 devstack sudo[109248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-16c85d68-a214-41e7-9089-68071a53f8ea Sep 07 14:06:42 devstack sudo[109248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:42 devstack sudo[109248]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-38d1663d-ddd6-4140-9949-0384e7ba05a0 tempest-SnapshotDependencyTests-1722212696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-16c85d68-a214-41e7-9089-68071a53f8ea" returned: 0 in 0.344s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:42 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-38d1663d-ddd6-4140-9949-0384e7ba05a0 tempest-SnapshotDependencyTests-1722212696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-16c85d68-a214-41e7-9089-68071a53f8ea {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:42 devstack sudo[109253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-16c85d68-a214-41e7-9089-68071a53f8ea Sep 07 14:06:42 devstack sudo[109253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:43 devstack sudo[109253]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-38d1663d-ddd6-4140-9949-0384e7ba05a0 tempest-SnapshotDependencyTests-1722212696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50/volume-16c85d68-a214-41e7-9089-68071a53f8ea" returned: 0 in 0.232s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-38d1663d-ddd6-4140-9949-0384e7ba05a0 tempest-SnapshotDependencyTests-1722212696 None] Lock "cinder-quobyte-16c85d68-a214-41e7-9089-68071a53f8ea" released by "delete_volume" :: held 0.613s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:43 devstack cinder-volume[87571]: DEBUG cinder.quota [None req-38d1663d-ddd6-4140-9949-0384e7ba05a0 tempest-SnapshotDependencyTests-1722212696 None] Created reservations ['b693cbac-cefe-4dc6-ba9e-5474c4caa8dd', '9f31a4e4-0e5f-4f75-8f38-9a2487ded827', 'fcb90d3e-bfeb-4527-9cb7-e20e9f83ec91', 'cac3de49-4353-4995-b6e6-ed20047e314d'] {{(pid=87571) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:06:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-38d1663d-ddd6-4140-9949-0384e7ba05a0 tempest-SnapshotDependencyTests-1722212696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:06:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-38d1663d-ddd6-4140-9949-0384e7ba05a0 tempest-SnapshotDependencyTests-1722212696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:06:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-38d1663d-ddd6-4140-9949-0384e7ba05a0 tempest-SnapshotDependencyTests-1722212696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285': None} {{(pid=87571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:06:43 devstack cinder-volume[87571]: DEBUG cinder.volume.drivers.quobyte [None req-38d1663d-ddd6-4140-9949-0384e7ba05a0 tempest-SnapshotDependencyTests-1722212696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3faf5cfc-51a0-4203-b7c7-43aae461f285'] {{(pid=87571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:06:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.lockutils [None req-38d1663d-ddd6-4140-9949-0384e7ba05a0 tempest-SnapshotDependencyTests-1722212696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:06:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-38d1663d-ddd6-4140-9949-0384e7ba05a0 tempest-SnapshotDependencyTests-1722212696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:43 devstack sudo[109256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50 Sep 07 14:06:43 devstack sudo[109256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:43 devstack sudo[109256]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:43 devstack cinder-volume[87571]: DEBUG oslo_concurrency.processutils [None req-38d1663d-ddd6-4140-9949-0384e7ba05a0 tempest-SnapshotDependencyTests-1722212696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab65f53cb4d20b2beb7aaa1ef19e6e50" returned: 0 in 0.224s {{(pid=87571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:43 devstack cinder-volume[87571]: DEBUG cinder.manager [None req-38d1663d-ddd6-4140-9949-0384e7ba05a0 tempest-SnapshotDependencyTests-1722212696 None] Notifying Schedulers of capabilities ... {{(pid=87571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:06:43 devstack cinder-volume[87571]: INFO cinder.volume.manager [None req-38d1663d-ddd6-4140-9949-0384e7ba05a0 tempest-SnapshotDependencyTests-1722212696 None] Deleted volume successfully. Sep 07 14:06:43 devstack cinder-volume[87571]: DEBUG cinder.coordination [None req-38d1663d-ddd6-4140-9949-0384e7ba05a0 tempest-SnapshotDependencyTests-1722212696 None] Lock "cinder-16c85d68-a214-41e7-9089-68071a53f8ea-delete_volume" released by "delete_volume" :: held 1.023s {{(pid=87571) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:59 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=21,cinder:UPDATE=30,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:06:59 devstack cinder-volume[87571]: DEBUG dbcounter [-] [87571] Writing DB stats cinder:SELECT=29,cinder:UPDATE=29,cinder:DELETE=2,cinder:INSERT=8 {{(pid=87571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}